757 Data Pipelines Jobs - Page 18

As a Data Engineer at Zebra, you will play a crucial role in understanding the technical requirements of clients and designing and constructing data pipelines to fulfill those requirements. In addition to developing solutions, you will also supervise the development of other Engineers. Strong verbal and written communication skills are necessary to effectively interact with clients and internal teams. The role demands a solid understanding of databases, SQL, cloud technologies, ecosystems like Databricks and GCP, version control tools such as Github, and modern data integration and orchestration tools like Databricks workflows on Azure/GCP and Airflow. Knowledge of Agentic AI frameworks like...

As a Senior Technical Manager at Best Buy, you will ensure the quality and integrity of the Software Development Life Cycle (SDLC) for your team. You will identify opportunities for improvement in how the team works and implement recommended tools and practices to enhance efficiency. Solving highly complex issues by applying sound technical approaches will be a key aspect of your role. Collaborating with Product and Experience Design (XD) partners, you will set the team's objectives and key results. Clear communication of context, setting expectations, and promoting a culture of inclusion and diversity are essential responsibilities. Understanding and evaluating the consequences and risks of...

As a Data Scientist at London Stock Exchange Group (LSEG), you will have the opportunity to join the dynamic Innovation & Intelligence Team within the Data & Analytics Operations function. This team comprises data scientists, engineers, and analysts who collaborate to deliver impactful automation and AI solutions that enhance operational performance across the organization. Working in an agile and collaborative environment, you will partner closely with Engineering and D&A Operations teams to shape the technology roadmap and drive innovation. The mission of the team is to accelerate value delivery while building scalable, future-ready capabilities. In this role, you will design and implement...

As an Associate Manager at Red Hat Experience Engineering (XE) in the XE AI and Data team, you will play a crucial role in leading and developing a new team dedicated to enhancing AI capabilities across associate and customer experiences. Your responsibilities will include guiding the team's career development, coaching, and mentoring team members in a technical, fast-paced environment. You will be expected to drive measurable impact by extending the use of AI capabilities and enhancing XE's foundational data assets, from governance to reporting strategy to cross-company data pipelines. Your daily tasks will involve using Open Management Principles to lead the team effectively, ensuring the ...

About Strand Life Sciences: Strand is a 24-year-old spin-off from the Indian Institute of Science, a cutting-edge Genomics company with a global customer base. Our focus is on building applications that utilize DNA sequencing to enhance human health. In this pursuit, we develop algorithms, data pipelines, and visualizations to manage substantial amounts of sequence data efficiently. Our core mission is to convert intricate data into actionable insights, thereby contributing to pioneering research and innovative solutions within the genomics field. We envision a future where millions of individuals will undergo DNA sequencing, and we welcome you to join us on this transformative journey. Abou...

About Mindcurv (Part of Accenture Song) Mindcurv, a part of Accenture Song, assists customers in reimagining their digital business, experiences, and technology to thrive in the new digital landscape. By crafting sustainable and accountable solutions for individuals residing in a digital world, Mindcurv addresses the market's imperative to digitalize business processes and enhance customer experiences while capitalizing on cloud technologies through the adoption of DevOps and agile methodologies. Your Role As a Senior Data Engineer at Mindcurv, you will play a key role within our expanding Data and Analytics team. We are looking for a candidate with extensive proficiency in Databricks and cl...

At Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative, and scientific capabilities, collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow, informed and validated by science and data, superpowered by creativity and design, all underpinned by technology created with purpose. Your role involves having IT experience with a minimum of 5+ years in creating data warehouses, data lakes, ETL/ELT, data pipelines on cloud. You should have experience in data pipeline implementation with cloud providers such as AWS, Azure, ...

The Applications Development Senior Programmer Analyst position is an intermediate level role where you will be responsible for participating in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. Your main objective will be to contribute to applications systems analysis and programming activities. You will be responsible for conducting tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establishing and implementing new or revised applications systems and programs to meet specific business needs or user areas. You will also m...

Intelligence Node is a real-time retail intelligence platform that enables businesses to enhance product-level profitability and boost margins by leveraging data-driven competitive insights. The cutting-edge technology of Intelligence Node employs AI to analyze billions of data points across 1,900 retail categories in 34 global markets. The business model of Intelligence Node offers a comprehensive suite of solutions, including product matching, digital shelf analytics, assortment & availability, pricing & promotions, and brand compliance. These solutions aid retailers and brands in making strategic and operational decisions. With a patented product matching engine and proprietary AI, Intell...

As a Data Architect at our company, you will be responsible for designing scalable data architectures for web-based platforms or cloud-native systems. Your role will involve hands-on experience with relational and NoSQL databases such as PostgreSQL, MongoDB, and Cassandra. Additionally, you will work with cloud-based data services, data pipelines, and orchestration tools like Azure Data Services, AWS, GCP, Apache Airflow, and Azure Data Factory. In this role, you will have the opportunity to utilize your expertise in Big Data technologies including Spark, Kafka, and Delta Lake. A deep understanding of data modeling, ETL/ELT processes, and data lifecycle management will be crucial to your suc...

You are a talented and experienced software development consultant specializing in Agile Delivery, working closely with the client to add real value to their products. In this role, you will work as a polyglot alongside great, like-minded individuals, continuously learning new technologies and implementing best practices. As a Data Engineer with proven senior-level experience, you will be responsible for creating data pipelines for ingest, transformation, and storage of data at scale, as well as setting up analytics clusters. Your main responsibilities will include collaborating with the client and the team to determine data processing and access needs, creating and supporting highly availab...

Tower Research Capital is a leading quantitative trading firm founded in 1998, known for its high-performance platform and independent trading teams. With a 25+ year track record of innovation, Tower has a reputation for discovering unique market opportunities. At Tower, you will find some of the world's best systematic trading and engineering talent. Portfolio managers are empowered to build their teams and strategies independently, benefiting from the economies of scale of a large, global organization. Engineers at Tower thrive while developing electronic trading infrastructure at a world-class level. They tackle challenging problems in low-latency programming, FPGA technology, hardware ac...

As a skilled and experienced Architect in web development and architecture, you will be responsible for architecting and building scalable, secure web applications. Your role will involve providing guidance to a team of developers, conducting code reviews, resolving blockers, and leading with clarity. Additionally, you will be driving architecture decisions that strike a balance between innovation, stability, and speed. Collaboration with product and business teams will be essential, as you own the platform design for various digital marketing aspects such as ad-tech, mar-tech, campaign automation, and analytics. To excel in this role, you should have at least 10-15 years of total experience...

We are seeking a skilled and passionate Prompt Engineer with expertise in Prompt Engineering and LLM-based application development. As a Prompt Engineer, you will be responsible for designing, developing, and scaling GenAI-powered applications using cutting-edge technologies in AI, full-stack development, and cloud computing. Your key responsibilities will include designing and developing AI applications utilizing Large Language Models (LLMs) such as GPT-4, Claude, or LLaMA. You will be tasked with writing, optimizing, and evaluating prompts for various tasks and use cases. Proficiency in Python, JavaScript (React/Node.js), or other full-stack technologies is essential for this role. Additio...

As a Machine Learning Intern at our company located in Surat, you will be involved in the annotation, building, training, evaluation, and fine-tuning of machine learning and deep learning models across various use cases. Your responsibilities will include implementing data pipelines for preprocessing, augmentation, and transformation of structured and unstructured datasets. Additionally, you will be expected to perform exploratory data analysis (EDA), feature engineering, and data visualization. Furthermore, you will work on computer vision and image/video processing tasks using industry-standard frameworks. Your role will also involve utilizing GPU acceleration (CUDA, cuDNN, TensorRT) for t...

As a Python Lead, you will be responsible for architecting modular, maintainable, and high-performance backend systems. You will own the backend lifecycle, including design, development, testing, and deployment. Your role will involve building and scaling RESTful APIs, microservices, and data pipelines. Additionally, you will be expected to drive clean code practices and provide technical mentorship to the team. Collaboration will be a key aspect of your job, as you will work closely with Product Managers, UI/UX Designers, QA Engineers, and DevOps to ensure seamless delivery. You will also need to continuously evaluate and adopt the latest tools, frameworks, and best practices in the field. ...

Responsibilities: Build modern data platform/lake components on cloud. Analysis and design of data pipelines that bring in various internal and external data into the data lake in the cloud based on the business use case. Design and development of data marts that make large volumes of data from the data lake accessible to business analysts and data scientists. Deliver solutions in an agile delivery model. Implement transformation and data quality rules using modern transformation tools and languages for data to conform to enterprise guidelines. Deep understanding of various stages of data model in the data platform (medallion architecture) etc. and implement it accordingly. Ways of Working A...

Description and Requirements Hands-on engineer in technical design and development of AI applications using existing and/or emerging technology. Work closely with product managers, data scientists and other stakeholders to translate business requirements into scalable and efficient AI solutions. Collaborate with cross-functional teams to execute the AI technology roadmap, aligning with business objectives and industry trends. Stay abreast of the latest advancements in AI technologies, guiding the team in adopting best practices and cutting-edge methodologies. Responsible for development of AI specific software/platform components. Investigate and resolve production management incidents, prob...

You are a highly motivated and skilled Python Data Science Professional sought to join the dynamic Production Management AIOps team. Your main focus will be on utilizing data science techniques and Python to create innovative solutions that optimize production processes, enhance predictive capabilities, and integrate AI/ML models into operational workflows. The ideal candidate is someone who is passionate about data science, possesses a deep understanding of Python's data science ecosystem, has experience in building and deploying machine learning models, and thrives on working with large datasets in a fast-paced, collaborative setting. In this role, your responsibilities will include analyz...

Key Responsibilities: Dataiku Leadership: Drive data engineering projects with a strong emphasis on utilizing Dataiku for data preparation, analysis, visualization, and building end-to-end data solutions. Data Pipeline Development: Design, develop, and optimize robust, scalable data pipelines supporting business intelligence and advanced analytics initiatives. Build and maintain ETL/ELT processes across diverse data sources. Data Modeling & Architecture: Apply data modeling best practices (dimensional, star schema, etc.) to create scalable and efficient database designs with a focus on performance and integrity. ETL/ELT Expertise: Build and manage ETL pipelines using tools such as Dataiku, A...

ABOUT THE ROLE Role Description: We are seeking a seasoned Engineering Manager (Data Engineering) to lead the end-to-end management of enterprise data assets and operational data workflows. This role is critical in ensuring the availability, quality, consistency, and timeliness of data across platforms and functions, supporting analytics, reporting, compliance, and digital transformation initiatives. You will be responsible for the day-to-day data operations, manage a team of data professionals, and drive process excellence in data intake, transformation, validation, and delivery. You will work closely with cross-functional teams including data engineering, analytics, IT, governance, and bus...

Key Responsibilities: Design and implement scalable data models using Snowflake and Erwin Data Modeler. Create, maintain, and enhance data pipelines using DBT and GCP (BigQuery, Cloud Storage, Dataflow). Perform reverse engineering on existing systems (e.g., Sailfish/DDMS) using DBeaver or similar tools to understand and rebuild data models. Develop efficient SQL queries and stored procedures for data transformation, quality, and validation. Collaborate with business analysts and stakeholders to gather data requirements and convert them into physical and logical models. Ensure performance tuning, security, and optimization of the Snowflake data warehouse. Document metadata, data lineage, and...

Key Responsibilities: Design and develop data processing pipelines and analytics solutions using Databricks. Architect scalable and efficient data models and storage solutions on the Databricks platform. Collaborate with architects and other teams to migrate current solutions to use Databricks. Optimize performance and reliability of Databricks clusters and jobs to meet SLAs and business requirements. Use best practices for data governance, security, and compliance on the Databricks platform. Mentor junior engineers and provide technical guidance. Stay current with emerging technologies and trends in data engineering and analytics to drive continuous improvement. Position Requirements: Bache...

Key Deliverables : Launch Rippling's Dashboards as the customer homepage for real-time analytics. Build systems for sub-2s latency over millions of rows using open-source technologies. Scale the Bangalore engineering team with senior hires and leadership. Define and execute a robust technology roadmap for analytics and reporting. Role Responsibilities : Lead engineering best practices and architecture for distributed analytics systems. Drive technical excellence and culture of ownership within the team. Collaborate with business and product teams to shape OKRs and delivery. Implement automated solutions for scalability, efficiency, and growth.

Key Deliverables : Design and implement scalable systems for processing compensation and performance data. Build efficient real-time data pipelines for secure and accurate payroll outputs. Lead development of consumer-grade features for performance-based compensation tools. Establish and uphold best practices in coding, system reliability, and security. Role Responsibilities : Provide architectural leadership and drive technical excellence across the team. Collaborate with cross-functional teams to align technical work with product vision. Mentor engineers and promote a high-performance team culture. Solve complex technical challenges and communicate solutions effectively.