867 Data Pipeline Jobs - Page 5

**Job Title:** Senior Data Engineer - Data **Company Name:** Happiest Minds **Location:** Bangalore **Job Type:** Full-time **About Happiest Minds:** Happiest Minds is a digital transformation and technology services company that aims to help businesses thrive in the digital age. We specialize in innovative technology solutions and services that enhance customer experiences, improve operational efficiencies, and enable sustainable growth. **Job Description:** We are seeking a highly skilled and motivated **Senior Data Engineer** to join our dynamic team. The ideal candidate will have between 5 to 8 years of experience in data engineering with a strong proficiency in Python, SQL, and Power BI...

Description: Must have skills: Python azure data factory Databricks Apache Spark / PySpark Azure Data Lake Store Azure Data Lake Analytics Pipeline Execution/ETL Machine Learning AI ETL clould data pipelines Docker Kubernetes AWS Requirements: About the Role We are seeking a talented and passionate Machine Learning Engineer to join our growing team. In this role, you will be responsible for developing and implementing machine learning models to solve real-world problems and drive business value. You will work closely with data scientists, software engineers, and product managers to design, build, and deploy innovative solutions. Key Responsibilities Design, develop, and implement machine lea...

Data Scientist Req number: R6198 Employment type: Full time Worksite flexibility: Onsite Who we are CAI is a global technology services firm with over 8,500 associates worldwide and a yearly revenue of $1 billion+. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients, colleagues, and communities. As a privately held company, we have the freedom and focus to do what is right—whatever it takes. Our tailor-made solutions create lasting results across the public and commercial sectors, and we are trailblazers in bringing neurodiversity to the enterprise. Job Summary We are looking for a motivated Data Scientist ready to take us to the next le...

About the Role: We are looking for a highly experienced Senior Solution Architect to join our Migration Works practice, specializing in modern data platforms and visualization tools. The ideal candidate will bring deep technical expertise in Tableau, Power BI, AWS, and Snowflake , along with strong client-facing skills and the ability to design scalable, high-impact data solutions. You will be at the forefront of driving our AI driven migration and modernization initiatives, working closely with customers to understand their business needs and guiding delivery teams to success. Key Responsibilities: Solution Design & Architecture Lead the end-to-end design of cloud-native data architecture u...

Job Summary: We are seeking a skilled and versatile Data Engineer with hands-on experience in Python , Power BI, Azure Data Factory, Java, and React. The ideal candidate will have domain expertise in Intraday Liquidity Stress Testing and Cash Flow Forecasting and will contribute to building scalable data pipelines and insightful dashboards for financial analytics. Key Responsibilities: Design, develop, and maintain scalable data pipelines and ETL processes using Python and Azure Data Factory. Orchestrate and automate data workflows using Azure Data Factory for efficient data movement and transformation. Develop and maintain Power BI dashboards to visualize financial data and support decision...

Trainer AI ML Data Science: Job Title: Trainer AI/ML/Data Science (Data Focus) Job Location: Chennai (MEPZ Tambaram) Experience: 45 Years Work Mode: Full-Time, Work from Office Job Description: We are seeking a passionate and experienced Trainer in AI/ML/Data Science with a strong focus on data engineering and big data technologies . The ideal candidate will have hands-on experience in delivering technical training and designing engaging learning content. Key Responsibilities: Deliver high-quality training sessions on AI, ML, and Data Science with emphasis on data engineering and big data tools. Design and develop training materials including presentations, labs, assessments, and case studie...

About the Role: - You will design, implement, and maintain database systems to support web application and services. - Your role involves optimizing database performance and ensuring data integrity and security. - You will collaborate closely with developers and other stakeholders to align database design with application requirements. About the Team: - You will be part of a dynamic and skilled team of database professionals committed to achieving excellence. - You will have opportunities to mentor junior team members and contribute to team growth through innovation. You are Responsible for: - Design and develop scalable database architecture. - Database migration from legacy system to Azure...

Position Overview: The Microsoft Cloud Data Engineer role is ideal for a highly capable and motivated Microsoft Cloud Data Engineer to design, build, and maintain cloud-based data solutions using Microsoft Azure technologies. This role is key for developing robust, scalable, and secure data pipelines and supporting analytics workloads that power business insights and data-driven decision-making. Key Responsibilities: Design and implement ETL/ELT pipelines using Azure Data Factory, Azure Synapse Analytics, Azure Databricks, and Azure Data Lake Storage. Develop and manage data integration workflows to ingest data from multiple sources including APIs, on-prem systems, and cloud services. Optimi...

Overview OMPD is an MSCI Climate “future go to” internal platform and critical data provider for client facing platform used which will be used by: MSCI Sustainability researchers develop the Sustainability model as per the latest regulations, industry and market specific needs MSCI data operations team manages the with Sustainability specific data MSCI analysts to work with the mode and data to create, validate and refine Sustainability reports External Clients. Responsibilities Delivering new functionality by writing and shipping high quality code for the OMDP meeting the MSCI requirements. Design, build, and maintain efficient, reusable, and reliable code. Design and implementation of con...

Skills - Snowflake, Apache Airflow, Terraform , DBT, Git, SQL, Spark and Python , Data Warehousing, CIi/CD Pipelines Key Responsibilities: Design, implement, and optimize data pipelines and workflows using Apache Airflow Develop incremental and full-load strategies with monitoring, retries, and logging Build scalable data models and transformations in dbt, ensuring modularity, documentation, and test coverage Develop and maintain data warehouses in Snowflake Ensure data quality, integrity, and reliability through validation frameworks and automated testing Tune performance through clustering keys, warehouse scaling, materialized views, and query optimization. Monitor job performance and reso...

The Role We are seeking an experienced Senior Software Data Engineer to join the Data Integrations Team, a critical component of the Addepar Platform team. The Addepar Platform is a comprehensive data fabric that provides a single source of truth for our product set, encompassing a centralized and self-describing repository, API driven data services, integration pipeline, analytics infrastructure, warehousing solutions, and operating tools. The Data Integrations team is responsible for the acquisition, conversion, cleansing, reconciliation, modeling, tooling, and infrastructure related to the integration of market and security master data from third-party data providers. This team plays a cr...

**Job Title:** Senior Data Engineer - Data **Company Name:** Happiest Minds **Location:** Bangalore **Job Type:** Full-time **Experience Required:** 5 - 8 years **About Happiest Minds:** Happiest Minds Technologies is a next-gen digital transformation and IT services company. We are committed to empowering enterprises to become future-ready with innovative solutions and services. Our culture fosters creativity, encourages collaboration, and values integrity. Join us in making a difference in the digital landscape. **Position Summary:** We are seeking a talented and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have a strong foundation in data management,...

**Job Title: Senior Data Engineer** **Company: Happiest Minds** **Location: Bangalore **Experience Required: 4 to 8 years** --- **About Happiest Minds:** Happiest Minds is a leading technology consulting and services company dedicated to helping businesses leverage technology to achieve their goals. We pride ourselves on fostering a culture of innovation, collaboration, and continuous learning. --- **Job Description:** We are seeking a highly skilled **Senior Data Engineer** to join our dynamic team. The ideal candidate will have a strong background in data engineering, particularly with Azure Databricks, and will be responsible for designing, building, and optimizing data pipelines and arch...

Company Description Cloud Destinations, headquartered in Silicon Valley, specializes in digital transformation and enterprise application development for the Healthcare, Retail, and Technology sectors. We excel in cloud migrations, multi-cloud operations, DevOps, security operations, and IoT. Our globally distributed team includes skilled technical experts and effective leaders who thrive on teamwork and respect for diverse viewpoints. For more details, visit our website: www.clouddestinations.com. Role Description This is a full-time, on-site role for a Data Engineer Manager located in Coimbatore . We are looking for a highly skilled Data Engineering Manager to lead and grow our data engine...

Calling all innovators find your future at Fiserv, Were Fiserv, a global leader in Fintech and payments, and we move money and information in a way that moves the world We connect financial institutions, corporations, merchants, and consumers to one another millions of times a day quickly, reliably, and securely Any time you swipe your credit card, pay through a mobile app, or withdraw money from the bank, were involved If you want to make an impact on a global scale, come make a difference at Fiserv, Job Title Data Engineer About Your Role At Fiserv, we are dedicated to transforming financial services technology to benefit our clients As Data Engineer you will play a key role in making sure...

About The Role Seeking a highly skilled Senior Snowflake Developer with 6 years of experience to join our dynamic team The ideal candidate will support the design, development and maintenance of Snowflake data warehouse solutions, working closely with senior developers, data analysts and business teams to deliver reliable and scalable data solutions, Requirements At least 4-7 years of experience in data engineering or data warehousing, Should have 1-3 years of hands-on experience with Snowflake, Sound SQL skills and understanding of data modelling concepts, Experience with ETL tools and data integration frameworks, Familiarity with cloud platforms (AWS, Azure or GCP), Must have primary under...

We are seeking a highly skilled Senior Consultant Data Engineer with expertise in Azure Data Factory (ADF), Databricks, and Azure Cloud to design, build, and optimize scalable data solutions The ideal candidate will have hands-on experience in implementing modern data pipelines, ETL/ELT processes, and data integration strategies to support analytics and business intelligence initiatives, Show more Show less

Experience : 6+ years as Azure Data Engineer including at least 1 E2E Implementation in Microsoft Fabric. Responsibilities : - Lead the design and implementation of Microsoft Fabric-centric data platforms and data warehouses. - Develop and optimize ETL/ELT processes within the Microsoft Azure ecosystem, effectively utilizing relevant Fabric solutions. - Ensure data integrity, quality, and governance throughout Microsoft Fabric environment. - Collaborate with stakeholders to translate business needs into actionable data solutions. - Troubleshoot and optimize existing Fabric implementations for enhanced performance. Skills : - Solid foundational knowledge in data warehousing, ETL/ELT processes...

SUMMARY About the Role: We are looking for a Senior Data Engineer to lead the design and implementation of scalable data infrastructure and engineering practices. This role will be critical in laying down the architectural foundations for advanced analytics and AI/ML use cases across global business units. You’ll work closely with the Data Science Lead, Product Manager, and other cross-functional stakeholders to ensure data systems are robust, secure, and future-ready. Key Responsibilities: Architect and implement end-to-end data infrastructure including ingestion, transformation, storage, and access layers to support enterprise-scale analytics and machine learning. Define and enforce data e...

Why Choose Decision Point At Decision Point , we empower data-driven transformation by delivering innovative, scalable, and future-ready analytics solutions. With a proven track record in the CPG, Retail, and Manufacturing industries, we combine deep domain expertise with cutting-edge technologies to enable smarter decisions at every level of the enterprise. By joining our team, youll be part of a collaborative culture that values creativity, learning, and continuous improvement. We offer opportunities to work on high-impact projects with global clients, and leverage the latest cloud and data engineering tools to solve real-world business challenges. Key Responsibilities Design, develop, and...

SUMMARY Job Summary We are looking for a Senior PySpark Developer with 3 to 6 years of experience in building and optimizing data pipelines using PySpark on Databricks, within AWS cloud environments. This role focuses on the modernization of legacy domains, involving integration with systems like Kafka and collaboration across cross-functional teams. Key Responsibilities Develop and optimize scalable PySpark applications on Databricks. Work with AWS services (S3, EMy, Lambda, Dlue) for cloud-native data processing. Integrate streaming and batch data sources, especially using Kafka. Tune Spark jobs for performance, memory, and compute efficiency. Collaborate with DevOps, product, and analytic...

About the Job : We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. In this pivotal role, you will be instrumental in driving our data engineering initiatives, with a strong emphasis on leveraging Dataiku's capabilities to enhance data processing and analytics. You will be responsible for designing, developing, and optimizing robust data pipelines, ensuring seamless integration of diverse data sources, and maintaining high data quality and accessibility to support our business intelligence and advanced analytics projects. This role requires a unique blend of expertise in traditional data engineering principles, advanced data modeling, and a forward-...

About The Opportunity : A fast-scaling technology company operating in the Enterprise AI / Generative AI sector, building production-grade LLM-driven products and intelligent automation for global clients. We deliver secure, low-latency generative systems that power conversational AI, summarization, code generation, and retrieval-augmented applications across cloud-native environments. We are hiring a Senior Generative AI Engineer (7+ years) to own architecture, model development, and production deployment of advanced generative systems. This is a fully remote role for candidates based in India. Role & Responsibilities : - Lead end-to-end design and delivery of Generative AI/LLM solutionsdat...

About the Job : We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. In this pivotal role, you will be instrumental in driving our data engineering initiatives, with a strong emphasis on leveraging Dataiku's capabilities to enhance data processing and analytics. You will be responsible for designing, developing, and optimizing robust data pipelines, ensuring seamless integration of diverse data sources, and maintaining high data quality and accessibility to support our business intelligence and advanced analytics projects. This role requires a unique blend of expertise in traditional data engineering principles, advanced data modeling, and a forward-...

About The Opportunity : A fast-scaling technology company operating in the Enterprise AI / Generative AI sector, building production-grade LLM-driven products and intelligent automation for global clients. We deliver secure, low-latency generative systems that power conversational AI, summarization, code generation, and retrieval-augmented applications across cloud-native environments. We are hiring a Senior Generative AI Engineer (7+ years) to own architecture, model development, and production deployment of advanced generative systems. This is a fully remote role for candidates based in India. Role & Responsibilities : - Lead end-to-end design and delivery of Generative AI/LLM solutionsdat...