671 Data Engineer Jobs - Page 26

Work closely with clients to understand business needs, design data solutions, and deliver insights through end-to-end data management. Lead project execution, handle communication, documentation, and guide team members throughout. Required Candidate profile Must have hands-on experience with Python, ETL tools (Fivetran, StitchData), databases, and cloud platforms (AWS, GCP, Azure, Snowflake, Databricks). Familiarity with REST/SOAP APIs is essential.

Mandate Skills: 1. ADF 2. Snowflake 3. Data Modeling 4. SQL 5. Python 6. Pyspark 7. Databricks Key Responsibilities: Design and develop robust data pipelines and ETL/ELT processes using Snowflake . Build and maintain dimensional and relational data models to support business intelligence and analytics. Develop SQL scripts and optimize queries for performance and scalability in Snowflake . Use Python for data processing, automation, and integration tasks as needed. Design, schedule, and manage pipelines using Azure Data Factory. Ensure data quality, consistency, and security across platforms. Work closely with data analysts, business stakeholders, and other engineers to gather requirements an...

As a GCP Data Engineer, your role will involve designing, developing, and maintaining data solutions on the Google Cloud Platform . You will be responsible for building and optimizing data pipelines, ensuring data quality and reliability, and implementing data processing and transformation logic. Your expertise in Databricks , Python , SQL , PySpark / Scala , and Informatica will be essential for performing the following key responsibilities: Key Responsibilities: Designing and developing data pipelines: Design and implement scalable and efficient data pipelines using GCP-native services (e.g., Cloud Composer, Dataflow, BigQuery) and tools like Databricks , PySpark , and Scala . This include...

Role & responsibilities Designing, building, and maintaining ETL/ELT pipelines using dbt and GCP services like BigQuery and Cloud Composer. Creating and managing data models and transformations using dbt to ensure efficient and accurate data consumption for analytics and reporting. Developing and maintaining a data quality framework, including automated testing and cross-dataset validation. Writing and optimizing SQL queries for efficient data processing within BigQuery. Working with data engineers, analysts, scientists, and business stakeholders to deliver data solutions. Supporting day-to-day incident and ticket resolution related to data pipelines. Creating and maintaining comprehensive d...

Notice Period - Immediate joiner Responsibilities Lead, develop and support analytical pipelines to acquire, ingest and process data from multiple sources Debug, profile and optimize integrations and ETL/ELT processes Design and build data models to conform to our data architecture Collaborate with various teams to deliver effective, high value reporting solutions by leveraging an established DataOps delivery methodology Continually recommend and implement process improvements and tools for data collection, analysis, and visualization Address production support issues promptly, keeping stakeholders informed of status and resolutions Partner closely with on and offshore technical resources Pr...

Job Description: Job Role: Data Engineer Role Yrs of Exp : 4+Years Job Location : Pune Work Model : Hybrid Job Summary: We are seeking a highly skilled Data Engineer with strong expertise in DBT, Java, Apache Airflow, and DAG (Directed Acyclic Graph) design to join our data platform team. You will be responsible for building robust data pipelines, designing and managing workflow DAGs, and ensuring scalable data transformations to support analytics and business intelligence. Key Responsibilities: Design, implement, and optimize ETL/ELT pipelines using DBT for data modeling and transformation. Develop backend components and data processing logic using Java. Build and maintain DAGs in Apache Ai...

Hi, Greetings!!! We are hiring for full time employment with one of the Product based company _ Hybrid Model. Main Skills: Data Engineer, DBT, Java, Apache, Any cloud Required Skills & Qualifications: 4+ years of hands-on experience in Data engineering roles. Strong experience with DBT for modular, testable, and version-controlled data transformation. Proficient in Java , especially for building custom data connectors or processing frameworks. Deep understanding of Apache Airflow and ability to design and manage complex DAGs. Solid SQL skills and familiarity with data warehouse platforms (e.g., Snowflake, Redshift, BigQuery). Familiarity with version control tools (Git), CI/CD pipelines, and...

Role & responsibilities At least 5 years of experience in data engineering with a strong background on Azure Databricks and Scala/Python. Experience in handling unstructured data processing and transformation with programming knowledge. Hands on experience in building data pipelines using Scala/Python Big data technologies such as Apache Spark, Structured Streaming, SQL, Databricks Delta Lake Strong analytical and problem solving skills with the ability to troubleshoot spark applications and resolve data pipeline issues. Familiarity with version control systems like Git, CICD pipelines usin

Position : Data Engineer Location : Hyderabad Experience : 5 Years Technical Skills: Experience with SQL and Pyspark. Tenure : 6 Months Functional Knowledge: Background in pharmaceutical data is beneficial. Ability to communicate with multiple stakeholders. Work collaboratively with data scientists and subject-matter experts to address data requirements. Identify and correct data inconsistencies and irregularities. Design data models and prepare data artifacts to meet business objectives. Experience developing ETL processes in high-performance environments such as Databricks and Snowflake. Fulfill customer requirements as specified by agreed service-level agreements (SLAs), utilizing structu...

Job Location: Hyderabad, Indore, Ahmedabad (India) Notice Period: Immediate joiners or within 15 days preferred Share Your Resume With: Current CTC Expected CTC Notice Period Preferred Job Location Primary Skills: MSSQL, Redshift, Snowflake T-SQL, LinkSQL, Stored Procedures ETL Pipeline Development Query Optimization & Indexing Schema Design & Partitioning Data Quality, SLAs, Data Refresh Source Control (Git/Bitbucket), CI/CD Data Modeling, Versioning Performance Tuning & Troubleshooting What You Will Do: Design scalable, partitioned schemas for MSSQL, Redshift, and Snowflake. Optimize complex queries, stored procedures, indexing, and performance tuning. Build and maintain robust data pipeli...

Job Description: We are seeking a talented and experienced Senior Data Engineer to join our Catalog Management department. In this role, you will be responsible for designing, developing, and maintaining robust and scalable data pipelines and infrastructure on Google Cloud Platform (GCP). You will work closely with data scientists, analysts, and other engineers to ensure data is readily available, reliable, and optimized for various analytical and operational needs. A strong focus on building automated testing into our data solutions is a must. The ideal candidate will have a strong background in Java development, Apache Spark, and GCP services, with a passion for building high-quality data ...

We are seeking a skilled Data Engineer to design, build, and maintain high-performance data pipelines within the Microsoft Fabric ecosystem. The role involves transforming raw data into analytics-ready assets, optimising data performance across both modern and legacy platforms, and collaborating closely with Data Analysts to deliver reliable, business-ready gold tables. You will also coordinate with external vendors during build projects to ensure adherence to standards. Key Responsibilities Pipeline Development & Integration Design and develop end-to-end data pipelines using Microsoft Fabric (Data Factory, Synapse, Notebooks). Build robust ETL/ELT processes to ingest data from both modern a...

HPE is seeking Data Engineer with strong experience in machine learning workflows to build and optimize scalable data systems. You'll work closely with data scientists and data engineers to power ML-driven solutions . --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Responsibilities: Collaborate closely with Machine Learning (ML) teams to deploy and monitor models in production, ensuring optimal performance and reliability. Design and implement experiments, and apply statistical analysis to validate model solutions and resu...

7-9 years of experience with data analytics, data modeling, and database design. 3+ years of coding and scripting (Python, Java, Scala) and design experience. 3+ years of experience with Spark framework. 5+ Experience with ELT methodologies and tools. 5+ years mastery in designing, developing, tuning and troubleshooting SQL. Knowledge of Informatica Power center and Informatica IDMC. Knowledge of distributed, column- orientated technology to create high-performant database technologies like - Vertica, Snowflake. Strong data analysis skills for extracting insights from financial data

Design, develop, and maintain robust and scalable data pipelines for ELT and ETL processes, ensuring data accuracy, completeness, and timeliness. Work with stakeholders to understand data requirements and translate

We are seeking a Sr. Data Engineer to join our Data Engineering team within our Enterprise Data Insights organization to build data solutions, design and implement ETL/ELT processes and manage our data platform to enable our cross functional stakeholders. As a part of our Corporate Engineering division, our vision is to spearhead technology and data-led solutions and experiences to drive growth & innovation at scale. The ideal candidate will have a strong Data Engineering background, advanced Python knowledge and experience with cloud services and SQL/NoSQL databases. You will work closely with our cross functional stakeholders in Product, Finance and GTM along with Business and Enterprise T...

Hiring for a leading MNC for position of Data Engineer , based at Kharadi (Pune) Designation : Data Engineer Shift Timing : 12 PM to 9 PM (Cab Facility Provided) Work Mode: Work from Office Key Responsibilities: - Liaise with stakeholders to define data requirements - Manage Snowflake & SQL databases - Build and optimize semantic models for reporting - Lead modern data architecture adoption - Reverse engineer complex data structures - Mentor peers on data governance best practices - Champion Agile/SCRUM methodologies Preferred Candidates: Experience- 5+ years in data engineering/BI roles - Strong ETL, data modelling, governance, and lineage documentation - Expertise in Snowflake, Azure (SQL ...

Required: Bachelors degree in computer science or engineering. 5+ years of experience with data analytics, data modeling, and database design. 3+ years of coding and scripting ( Python , Java, Scala) and design experience. 3+ years of experience with Spark framework. Experience with ELT methodologies and tools. Experience with Vertica OR Teradata Expertise in tuning and troubleshooting SQL. Strong data integrity, analytical and multitasking skills. Excellent communication, problem solving, organizational and analytical skills. Able to work independently. Additional / preferred skills: Familiar with agile project delivery process. Knowledge of SQL and use in data access and analysis. Experien...

Perform ETL operations using Dataiku and other ETL tools,expertise in ETL development and tools like Informatica.Strong coding skills in Python and SQL.Experience in Data Engineering, Data Integration, and Data Analysis

Role & responsibilities : Design, develop, and maintain scalable data pipelines and solutions on Azure. Work on Databricks engineering and architecture , ensuring data quality and integrity. Perform data modeling , system analysis, and contribute to database administration tasks. Collaborate with cross-functional teams to understand business requirements and implement data solutions accordingly. Participate in project and resource planning and ensure timely delivery of data solutions. Must-Have Skills: Banking domain experience is mandatory. Proven experience in Azure , Databricks , SQL , and data modeling . Strong expertise in financial crime detection or compliance data . Knowledge of data...

Greetings from Peoplefy Infosolutions !!! We are hiring for one of our reputed MNC client based in Pune . We are looking for candidates with 7 + years of experience as a Sr. Data Engineer. Primary Skills Strong experience in Data Engineering Python AI /ML in Data Engineering Big Query / Snowflake AWS / GCP Interested candidates for above position kindly share your CVs on Priyanka.sar@peoplefy.com with below details - Experience : CTC : Expected CTC : Notice Period : Location :

Role & responsibilities Responsibilities: Lead and participate in the development of high-quality software solutions for client projects, using modern programming languages and frameworks. Contribute to system architecture and technical design decisions, ensuring that solutions are scalable, secure, and meet client requirements. Work closely with clients to understand their technical needs and business objectives, offering expert advice on software solutions and best practices. Provide guidance and mentorship to junior developers, assisting with code reviews, troubleshooting, and fostering a culture of technical excellence. Work with project managers, business analysts, and other engineers t...

Role & responsibilities Description Data engineering with data modeling experience, SQL, PySpark, Python, CICD with GitHub actions, API development and similar Long Description SQL + Data Modelling + CI/CD + Git Hub + Python-SQL + Data Modelling + CI/CD + Git Hub + Python.

Key Responsibilities: Design & Develop Data Pipelines : Build and optimize scalable, reliable, and automated ETL/ELT pipelines using AWS services (e.g., AWS Glue, AWS Lambda, Redshift, S3) and Databricks . Cloud Data Architecture : Design, implement, and support in maintaining data infrastructure in AWS , ensuring high availability, security, and scalability. Work with lake houses, data lakes, data warehouses, and distributed computing. DBT Core Implementation : Lead the implementation of DBT Core to automate data transformations, develop reusable models, and maintain efficient ELT processes. Data Modelling : Build efficient data models to support required analytics/reporting. Optimize Data ...

Skills : Data Engineer, Python, GCP, SQL Exp : 5-10 yrs Location :Pune