6525 Data Engineering Jobs - Page 19

Hands-on experience with AWS services including S3, Lambda,Glue, API Gateway, and SQS. Strong skills in data engineering on AWS, with proficiency in Python ,pyspark & SQL. Experience with batch job scheduling and managing data dependencies. Knowledge of data processing tools like Spark and Airflow. Automate repetitive tasks and build reusable frameworks to improve efficiency. Provide Run/DevOps support and manage the ongoing operation of data services. (Immediate Joiners).

Roles & Responsibilities Fabric Data Pipeline Development: Design, build, and maintain pipelines in Microsoft Fabric Data Factory & Dataflows Gen2 to extract, transform, and load (ETL/ELT) data from multiple sources into OneLake . DataOps & Governance: Implement and monitor DataOps practices (observability, quality checks, lineage) using Microsoft Purview, Fabric Monitoring, and Fabric Data Activator , ensuring compliance, reliability, and continuous improvement. CI/CD & DevOps: Create and maintain CI/CD pipelines for Fabric workspaces, notebooks, and data pipelines using Azure DevOps or GitHub Actions , with automated testing and environment promotion. Data Infrastructure Management: Manage...

About The Role Technical Min of 3 years exp as Data engineer with exposure to min of 1 ETL tool and knowledge of developing Data pipelines on cloud ecosystem Experience in Extracting data from heterogeneous sources, including databases, CRM systems, flat files, web services, etc. Knowledge of Data warehousing concept and how data moving from one layer to another till visualization layer. Transforming the extracted data involves cleaning, aggregating, mapping, and converting it to ensure it meets the business requirements and is in a suitable format for analysis. Experience in Design, implement, and continuously expand data pipelines by performing extraction, transformation, and loading activ...

About The Role Job TitleAWS Cloud Data Engineer Location: Bangalore About The Role : Fidelity Investments is undertaking an exciting transition from on-premises Oracle Analytical platform to a cloud-based Snowflake Analytical platform. As an AWS Cloud Data Engineer at Fidelity, you will play a pivotal role in migrating and managing our analytical platform on the cloud. The ideal candidate will have a strong foundation in SQL, experience with Snowflake, and proficiency in Python scripting. Additionally, hands-on experience with various AWS services is essential. Your work will directly contribute to the efficiency, scalability, and reliability of our data solutions. Key Responsibilities: SQL ...

About The Role Location: Bangalore Experience: 6 - 9 Years Role Overview: We are looking for a Data Engineer with strong expertise in Python, PySpark, AWS Glue, and Lambda . The ideal candidate should have experience in data processing, transformation, and cloud-based data workflows . A strong foundation in PL/SQL and PostgreSQL is required, and experience with AWS services such as SNS and Step Functions, along with Java API development, would be a plus . Key Responsibilities: Develop and optimize ETL pipelines using AWS Glue, Lambda, and PySpark . Work with large-scale data processing and transformation using Python and Spark . Design and implement data workflows for structured and unstruct...

About The Role Experience Architecting Enterprise Data Platforms for large Enterprises Evolved point of view and wide ranging experience in Data Governance,. Data Quality, Data Lineage Very strong, hands-on expertise in Data Supply Chain, Data Pipelines Strong experience in Google Cloud, Cloud Data Platforms Experience creating Data Analytics workspaces Leading and Guiding the team on all aspects of Data Engineering, Data Analytics Experience working Banking Domain, especially Private Wealth Management strongly preferred. Tech Skill SetsGoogle Cloud Data Platform, NoSQL AbInitio ReportingLooker, Tableau, Cognos

About The Role Location: Pune, India Role Overview: We are seeking a Senior Machine Learning Software Engineer to join our team and drive the development of cutting-edge AI/ML solutions . You will play a key role in designing, building, and optimizing our machine learning infrastructure while collaborating with Product Managers, Data Scientists, and Engineers to bring innovative models into production. The ideal candidate should have a strong background in ML operations, software engineering, and automation to ensure a scalable and robust AI-driven ecosystem. Key Responsibilities: Operationalize leading data and analytics technologies while following best practices. Partner with Product Mana...

Role & Responsibilities Passing year: 2024 & 2025 Qualifications : B.E./B.Tech, M.E./M.Tech, M.Sc., or MCA in Computer Science, Data Science, Artificial Intelligence, Machine Learning, or related fields. Objective The core objective is to hire candidates who have cleared any of the below mentioned Microsoft certifications: DP-600: Implementing Analytics Solutions Using Microsoft Fabric. DP-700: Implementing Data Engineering Solutions Using Microsoft Fabric. AI-102: Designing and implementing a Microsoft Azure AI Solution. Interview process a) The candidate will have to clear two rounds of interviews: Written test (Technical - Database concepts, Data Engineering concepts, Machine Learning con...

About The Role Location: Pune Responsibilities include: Design, implement, and optimize end-to-end data pipelines for ingesting, processing, and transforming large volumes of structured and unstructured data. Develop data pipelines to extract and transform data in near real-time using cloud-native technologies. Implement data validation and quality checks to ensure accuracy and consistency. Monitor system performance, troubleshoot issues, and implement optimizations to enhance reliability and efficiency . Collaborate with business users, analysts, and other stakeholders to understand data requirements and deliver tailored solutions. Document technical designs, workflows, and best practices t...

About The Role Job TitlePySpark Data Reconciliation Engineer 7+ years of relevant experience in technology and development. Technical skillset required (1) LanguageJava or Python (2) Experience with BigData/Hadoop/Spark/Kafka (3) Experience with APIs and microservices architecture (4) UI Development and integration experience would be a plus. Domain required Experience in a capital market domain. Experience in Regulatory reporting or reconciliations (tech) would be a big plus. Proven track record of delivering large scale projects with globally distributed teams. Strong experience in applications development, design paradigms. Previous experience with data domain would be a plus. Experience ...

About The Role This role involves the development and application of engineering practice and knowledge in defining, configuring and deploying industrial digital technologies (including but not limited to PLM and MES) for managing continuity of information across the engineering enterprise, including design, industrialization, manufacturing and supply chain, and for managing the manufacturing data. About The Role - Grade Specific Senior Data Engineer LocationFlexible / Remote Experience10+ years Capgemini empowers you to shape your career, supported by a global community. Join us in unlocking the value of data and driving sustainable growth. Your Role As a Senior Data Engineer, you will desi...

About The Role A Data Platform Engineer specialises in the design, build, and maintenance of cloud-based data infrastructure and platforms for data-intensive applications and services. They develop Infrastructure as Code and manage the foundational systems and tools for efficient data storage, processing, and management. This role involves architecting robust and scalable cloud data infrastructure, including selecting and implementing suitable storage solutions, data processing frameworks, and data orchestration tools. Additionally, a Data Platform Engineer ensures the continuous evolution of the data platform to meet changing data needs and leverage technological advancements, while maintai...

Your Role We are seeking an exceptional Data Scientist with specialized expertise in developing multi-agent AI systems. In this role, you will design, implement, and optimize complex AI ecosystems where multiple intelligent agents collaborate to solve sophisticated problems. You will leverage your deep understanding of generative AI, retrieval-augmented generation (RAG), and prompt engineering to create cutting-edge solutions that push the boundaries of artificial intelligence Your Profile Design and develop generative AI-based multi-agent systems that can collaborate, communicate, and coordinate to achieve complex objectives Architect and implement RAG-based chatbot solutions that effective...

Type: Contract-to-Hire (C2H) Job Summary We are looking for a skilled PySpark Developer with hands-on experience in building scalable data pipelines and processing large datasets. The ideal candidate will have deep expertise in Apache Spark , Python , and working with modern data engineering tools in cloud environments such as AWS . Key Skills & Responsibilities Strong expertise in PySpark and Apache Spark for batch and real-time data processing. Experience in designing and implementing ETL pipelines, including data ingestion, transformation, and validation. Proficiency in Python for scripting, automation, and building reusable components. Hands-on experience with scheduling tools like Airfl...

This is 100% WFO opportunity at our Whitefield, Bengaluru office. Please don't apply if you can't comply. Position Overview: We seek a highly skilled and experienced Data Engineering Lead to join our team. This role demands deep technical expertise in Apache Spark, Hive, Trino (formerly Presto), Python, AWS Glue, and the broader AWS ecosystem. The ideal candidate will possess strong hands-on skills and the ability to design and implement scalable data solutions, optimise performance, and lead a high-performing team to deliver data-driven insights. Key Responsibilities: Technical Leadership Lead and mentor a team of data engineers, fostering best practices in coding, design, and delivery. Dri...

Overview of the Company: Jio Platforms Ltd. is a revolutionary Indian multinational tech company, often referred to as India's biggest startup, headquartered in Mumbai. Launched in 2019, it's the powerhouse behind Jio, India's largest mobile network with over 400 million users. But Jio Platforms is more than just telecom. It's a comprehensive digital ecosystem, developing cutting-edge solutions across media, entertainment, and enterprise services through popular brands like JioMart, JioFiber, and JioSaavn. Join us at Jio Platforms and be part of a fast-paced, dynamic environment at the forefront of India's digital transformation. Collaborate with brilliant minds to develop next-gen solutions...

We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment. Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow orchestration using Airflow or similar frameworks. - Design, implement, and manage data warehouse solutions, schema evolution, and data versioning. - Collaborate with cross-functional teams to deliver high-quality data solutions. Req...

We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment. Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow orchestration using Airflow or similar frameworks. - Design, implement, and manage data warehouse solutions, schema evolution, and data versioning. - Collaborate with cross-functional teams to deliver high-quality data solutions. Req...

Roles and Responsibilities : Design, develop, test, deploy and maintain large-scale data pipelines using Palantir Technologies. Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions on time. Develop complex SQL queries to extract insights from large datasets and provide actionable recommendations to stakeholders. Troubleshoot issues related to data quality, performance, and security in the pipeline. Job Requirements : 3-10 years of experience in Data Engineering with expertise in Palantir Technologies. Strong proficiency in Python programming language for building scalable data pipelines. Experience working with relational databases (SQL) for query...

Design and implement scalable data architectures to optimize data flow and analytics capabilities. Develop ETL pipelines, data warehouses, and real-time data processing systems. Must have expertise in SQL, Python, and cloud data platforms like AWS Redshift or Google BigQuery. Work closely with data scientists to enhance machine learning models with structured and unstructured data. Prior experience in handling large-scale datasets is preferred. Mandatory Key Skills - sql,python,data warehousing,etl,amazon redshift,Data Engineering.

Role & responsibilities Python data engineer, Knowledge of AWS, Snowflake platform, lambda, SQL services, APIs, basic knowledge of AWS services, Business equity. ,

Role & responsibilities Job Description: We are looking for an experienced Data Engineer with expertise in Python and GCP stack to join our team. The ideal candidate will design, develop, and optimize scalable data pipelines, ensuring efficient data ingestion, transformation, and storage. Key Responsibilities: Build, optimize, and maintain large-scale data pipelines and ETL workflows on Google Cloud Platform (GCP) . Work with Python for data processing, automation, and integration tasks. Leverage GCP services such as BigQuery, Pub/Sub, Dataflow, Dataproc, and Cloud Storage (GCS) . Ensure data quality, scalability, and performance optimization. Collaborate with data scientists, analysts, and ...

Job Title: Senior Data Engineer Azure Databricks Experience: 7+ Years Location: Navi Mumbai (On-site) Job Overview: We are looking for a highly skilled Senior Data Engineer with expertise in Azure Databricks, big data technologies, and cloud-based data architectures. The ideal candidate will have hands-on experience building scalable data pipelines and platforms for high-volume batch and real-time processing, preferably in the manufacturing or energy sector. Key Responsibilities: • Design and implement robust data pipelines using Azure Databricks, Spark, and other Azure data services. • Collaborate with architects, data scientists, and business teams to understand requirements and translate ...

Contract Duration : 4 Months (Extendable based on Performance) Job Timings : India Evening Shift (till 11 : 30 PM IST) Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-cloud environments (AWS, Azure, ...

Contract Duration : 4 Months (Extendable based on Performance) Job Timings : India Evening Shift (till 11 : 30 PM IST) Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-cloud environments (AWS, Azure, ...