658 Data Engineer Jobs - Page 6

Job role - Developer Experience - 6 to 10 years Location - Kolkata AWS Databricks Developer Experience More than 3 years in data integration, pipeline development, and data warehousing, with a strong focus on AWS Databricks. Technical Skills Proficiency in Databricks platform, management, and optimization. Strong experience in AWS Cloud, particularly in data engineering and administration, with expertise in Apache Spark, S3, Athena, Glue, Kafka, Lambda, Redshift, and RDS. Proven experience in data engineering performance tuning and analytical understanding in business and program contexts. Solid experience in Python development, specifically in pySpark within the AWS Cloud environment, inclu...

We are seeking experienced Data Engineers for a C2H role in Hyderabad / Pune The ideal candidates should have 6- 8 years of relevant experience in designing, developing, and maintaining scalable data pipelines, working with large datasets, and integrating data from multiple sources Responsibilities include building ETL processes, ensuring data quality, supporting analytics and reporting, and collaborating with cross-functional teams to deliver efficient data solutions Strong problem-solving and technical skills are required

Role & Responsibilities : Design, build, and optimize modern data solutions for our mid-market and enterprise clients Transform raw data into trusted, analytics-ready assets that power dashboards, advanced analytics, and AI use cases working primarily inside the Microsoft stack (Azure, Synapse, and Microsoft Fabric) Develop scalable, well-documented ETL/ELT pipelines using T-SQL, Python, Azure Data Factory/Fabric Data Pipelines, and Databricks; implement best-practice patterns for performance, security, and cost control. Design relational and lakehouse models; create Fabric OneLake shortcuts, medallion-style layers, and dimensional/semantic models for Power BI. Build automated data-quality c...

You are applying for the position of Technical Recruiter/Senior Recruiter at Net2Source, a rapidly growing staffing firm with a strong presence across North America, LATAM, APAC, and EMEA regions. In this role, you will collaborate closely with the Delivery Team to source top talent within the Oil, Gas, Energy, and Pipeline Industry. **Key Responsibilities:** - Having 6 months to 2 years of overall recruiting experience. - Demonstrating 6 months to 2 years of recent experience in recruiting both contract and permanent roles. - Possessing a deep understanding of the Oil, Gas, Energy, and Pipeline Industry. - Working on positions such as Mechanical, Civil, Construction Manager, SCADA, Snowflak...

Experience in developing and delivering scalable big data pipelines using Apache Spark and Databricks on AWS. Position Requirements : Must Have : Build and maintain scalable data pipelines using Databricks and Apache Spark. Develop and optimize ETL/ELT processes for structured and unstructured data. Knowledge of Lakehouse architecture for efficient data storage, processing, and analytics. Orchestrating ETL/ELT Pipelines: Design and manage data workflows using Databricks Workflows, Jobs API. Worked with AWS Data Services (S3, Lambda, CloudWatch) for seamless integration. Performance Optimization: Optimize queries using pushdown capabilities and indexing strategies. Worked on data governance w...

Strong expertise in data transformation and pipeline development (SQL, Python, DBT) Strong expertise and experience in Data Vault 2.0 modeling framework IDE-savvy, working with dbt CLI locally and github copilot Build dbt model following the DV2.0 and Starschemas Working knowledge of Snowflake Ability to design and optimize scalable data workflows Exposure to CI/CD and cloud data platforms is an added advantage

Role & Responsibilities As a Data & AI Engineer at Vanderlande , you will be part of a dynamic team responsible for building and scaling our Azure-based data platform. Youll work closely with cross-functional teams to deliver high-impact data products and AI solutions that support business decision-making and innovation. Your responsibilities will include: Designing and developing data pipelines using Azure Data Factory , Databricks , and PySpark Building and deploying Machine Learning models using Python , SQL , and MLOps tools Processing structured and unstructured data , including implementing RAG (Retrieval-Augmented Generation) techniques Setting up and maintaining CI/CD pipelines for d...

Hello, We are hiring for "Data Engineer+Java" for Pune location. Exp:4+Years Loc: Pune Notice Period: Immediate joiners(notice period served or serving candidate) Mandatory Skills : Data Engineer(ETL) Data Build Tool Apache Airflow Java SQL Python PySpark NOTE: We are looking for Immediate joiners(notice period served or serving candidate) Apply only If you are Immediate joiners(notice period served or serving candidate) Apply only if you are having 4+Years of relevant experience into the above mentioned mandatory skills. Job Summary: We are seeking a highly skilled Data Engineer with strong expertise in DBT, Java, Apache Airflow, and DAG (Directed Acyclic Graph) design to join our data plat...

You have 4-6 years of experience and possess primary skillset in GCP Cloud and API development. Your experience in GCP should include working with BigQuery, Google Cloud Composer, Dataflow, Dataform, and Pub/Sub. Proficiency in Python for API development or Java Spring Boot is required. Knowledge of DevOps tools like Git and experience in CI/CD is also necessary. Familiarity with Elastic Search is considered a plus. As a Data Engineer, you will also be responsible for API development and ensuring the scalability of API and data pipelines.,

You are applying for the role of Principal Engineer within the Accounting & Finance Technology domain at TMUS Global Solutions, a subsidiary of T-Mobile US, Inc. In this role, you will be responsible for shaping next-generation financial data architecture by leveraging Snowflake, dbt, and modern data engineering practices to build scalable, trusted, and cost-optimized financial data solutions. Your main focus will be on transforming complex business requirements into robust financial systems that drive insights, compliance, and long-term growth in close collaboration with Finance and Accounting stakeholders. **Key Responsibilities:** - Architect & Lead Snowflake Solutions: Drive design and i...

As a Senior Databricks Engineer at MLAI_Digital, you will be responsible for working on-site in Mumbai to deliver solutions on the Azure Cloud using core cloud data warehouse tools like Azure Data Factory, Azure Databricks, Azure SQL DW, and other Big Data related technologies. Your main focus will be on building the next generation of application data platforms and improving recent implementations. This role requires expertise in analyzing data, developing strategies for populating data lakes, and complex coding using U-SQL, Scala or Python, and T-SQL. **Key Responsibilities:** - Implementing Data warehousing Solutions - Programming experience in Scala or Python, SQL - Hands-on experience i...

A Data Engineer is responsible for designing, building, and maintaining large-scale data systems and infrastructure Their primary goal is to ensure that data is properly collected, stored, processed, and retrieved to support business intelligence, analytics, and data-driven decision-making, Key Responsibilities Design and Develop Data Pipelines: Create data pipelines to extract data from various sources, transform it into a standardized format, and load it into a centralized data repository, Build and Maintain Data Infrastructure: Design, implement, and manage data warehouses, data lakes, and other data storage solutions, Ensure Data Quality and Integrity: Develop data validation, cleansing,...

A Data Engineer is responsible for designing, building, and maintaining large-scale data systems and infrastructure Their primary goal is to ensure that data is properly collected, stored, processed, and retrieved to support business intelligence, analytics, and data-driven decision-making, Key Responsibilities Design and Develop Data Pipelines: Create data pipelines to extract data from various sources, transform it into a standardized format, and load it into a centralized data repository, Build and Maintain Data Infrastructure: Design, implement, and manage data warehouses, data lakes, and other data storage solutions, Ensure Data Quality and Integrity: Develop data validation, cleansing,...

Hello, We are hiring for "Data Engineer+Java" for Pune location. Exp:4+Years Loc: Pune Notice Period: Immediate joiners(notice period served or serving candidate) Mandatory Skills : Data Engineer(ETL) Data Build Tool Apache Airflow Java SQL Python PySpark NOTE: We are looking for Immediate joiners(notice period served or serving candidate) Apply only If you are Immediate joiners(notice period served or serving candidate) Apply only if you are having 4+Years of relevant experience into the above mentioned mandatory skills. Job Summary: We are seeking a highly skilled Data Engineer with strong expertise in DBT, Java, Apache Airflow, and DAG (Directed Acyclic Graph) design to join our data plat...

Requisition Id : 1637208 Role: Data Engineer Role Summary: The Data Engineer, Senior Specialist is responsible for designing, developing and optimizing data pipelines and architectures to support scalable and efficient data processing This role involves working with complex datasets, integrating multiple data sources and ensuring high data quality and reliability, Roles and Responsibilities: Develop and maintain efficient ETL (Extract, Transform, Load) pipelines that ingest, process and transform large datasets from diverse sources, Build and manage data storage solutions using relational and non-relational databases, ensuring high availability, performance and scalability, Work with APIs, t...

At Alstom, we understand transport networks and what moves people From high-speed trains, metros, monorails, and trams, to turnkey systems, services, infrastructure, signalling and digital mobility, we offer our diverse customers the broadest portfolio in the industry Every day, 80,000 colleagues lead the way to greener and smarter mobility worldwide, connecting cities as we reduce carbon and replace cars, PURPOSE OF THE JOB: The purpose of the job is to develop through iterative process data Integration and analytics solutions Develop data products answering to Projects/Customer needs, from the data ingestion to ML productization, You will Build data analytics solutions, developing Data app...

Roles & Responsibilities: Designing and building optimized data pipelines using cutting-edge technologies in a cloud environment to drive analytical insights. Constructing infrastructure (on cloud - GCP) for efficient ETL processes from various sources and storage systems. Creating innovative data validation methods and data analysis tools. Ensuring compliance with data governance and security policies. Conducting complex data analysis and presenting results effectively. Continuously exploring opportunities to enhance data quality and reliability. Data Modeling: oCreate and maintain data models that support business requirements and data analytics. oEnsure data structures are optimized for p...

Key Skills: Data Engineer, Pyspark, SQL, Azure, Azure Cloud, ETL, Snowflake DB, MySQL, Ms Sql Roles and Responsibilities: Design, develop, and maintain robust ETL processes to support data integration and transformation. Utilize Azure services, including Azure Databricks and Azure ADF, for data processing and orchestration. Implement and manage data storage solutions using Snowflake DB and SQL databases. Collaborate with data scientists and analysts to understand data requirements and deliver high-quality datasets. Optimize SQL queries for performance and efficiency, leveraging advanced SQL techniques such as joins, subqueries, and CTEs. Ensure data quality and integrity through rigorous tes...

Hi, Greetings!!! Full time employment with "Product based Company" Job details Role: Sr Data Engineer Job Type - Full Time Opportunity Experience: 6+ years Location : Pune Work Mode : Hybrid We are seeking a highly skilled Data Engineer with strong expertise in DBT, Java, Apache Airflow, and DAG (Directed Acyclic Graph) design to join our data platform team. You will be responsible for building robust data pipelines, designing and managing workflow DAGs, and ensuring scalable data transformations to support analytics and business intelligence. Required Skills & Qualifications: 4+ years of hands-on experience in Data engineering roles. Strong experience with DBT for modular, testable, and ver...

Role & responsibilities We are looking for a Senior Data Engineer with strong expertise in SQL, Python, Azure Synapse, Azure Data Factory, Snowflake, and Databricks. The ideal candidate should have a solid understanding of SQL (DDL, DML, query optimization) and ETL pipelines while demonstrating a learning mindset to adapt to evolving technologies. Required Skills & Qualifications: SQL Expertise Strong hands-on experience with DDL, DML, query optimization, and performance tuning. Programming Languages – Proficiency in Python or Java for data processing and automation. Data Modelling – Good understanding of entity-relationship modelling, star schema, and Kimball methodology. Cloud Data Enginee...

• Proficient in Git for version control , SQL & exp with DB technologies,data pipeline tools such as Apache Airflow,data migration and validation techniques.Strong knowledge of Apache Spark for data processing and transformation,data governance.

Role Summary: We are seeking an experienced Data Engineer (4-8 years) with hands-on expertise in Snowflake, Azure Synapse Analytics, advanced SQL query development, and DevOps-driven object deployment automation. The role involves designing robust data pipelines, optimizing data warehouse performance, and enabling CI/CD for database objects using Jenkins or Azure DevOps. Responsibilities: Design, build, and maintain scalable data pipelines on Snowflake and Azure Synapse Analytics for structured and semi-structured data. Develop, optimize, and troubleshoot complex SQL queries for ETL, aggregation, and reporting tasks across Snowflake and Synapse. Implement automated CI/CD pipelines for Snowfl...

Job Description: You should have previous experience as a RTOC specialist with real-time monitoring and analysis of drilling data. Your excellent communication skills will be essential to coordinate with customers and rig sites simultaneously. Prior field experience as a Data Engineer or M/LWD Engineer, along with exposure to software for drilling optimization, will be advantageous. Key Responsibilities: - Real-time monitoring and analysis of drilling data - Coordinating with customers and rig sites simultaneously - Utilizing software for drilling optimization Qualifications Required: - Graduate or above in Geology, Applied Geology, Geoscience, Petroleum Technology, or B.E. in Petroleum or M...

Role: Data Engineer Exp: 5+ Years Shift: Night shift Salary: DOE Work Location: Hyderabad (Gachibowli) We are presently looking to fill the Data Engineer. Below, you'll find the job description for the role. When reviewing resumes, please ensure that candidates have experience with Databricks listed on their resume. Role Overview: As a Data Engineer, you will be responsible for designing, building, and maintaining our data infrastructure, ensuring its scalability, reliability, and efficiency. You will work closely with cross-functional teams to understand data requirements, develop ETL pipelines, and implement solutions for data processing, storage, and analysis. Key Responsibilities: Design...

As a Data Engineer with more than 6 years of experience in building and managing data processing pipelines for analytics usage, you will be responsible for the following: - Ability to understand the business use case and translate it into technical data requirements. - Building data pipelines that can clean, transform, and aggregate data from disparate sources. - Maintaining and re-engineering existing ETL processes to improve data accuracy, stability, and pipeline performance. - Staying up-to-date with advances in data persistence and big data technologies to design scalable data architectures for increasing data sets. - Automating tasks wherever applicable. - Reviewing and ensuring the qua...