4 - 8 years

Pune Gurugram Bengaluru

Posted:4 hours ago

Job Description

Hi Candidates ,

Urgently hiring for Data Engineer

Experience: 4-8 years

Notice Period

Role Type: Data Engineering / Azure / Databricks

Role Overview

We are looking for a hands-on Data Engineer with strong experience in Azure Databricks, PySpark, Python and advanced SQL to build and optimize enterprise data pipelines and data solutions for MetLife's Data & Analytics ecosystem.

Key Responsibilities

  • Develop scalable ETL/ELT pipelines using Azure Databricks, PySpark and SQL.
  • Work with structured and semi-structured data across Oracle, Azure SQL and cloud data platforms.
  • Build data ingestion, transformation, validation and reconciliation processes.
  • Develop and optimize Spark/PySpark jobs for performance and scalability.
  • Work on Delta Lake / Lakehouse / Medallion architecture and data engineering frameworks.
  • Troubleshoot production issues, pipeline failures and data-quality issues.
  • Implement SCD, CDC, MERGE/UPSERT and incremental data processing patterns.
  • Work with Azure services such as ADF, ADLS, Azure SQL and Synapse.
  • Collaborate with architects, business analysts and other engineering teams to convert requirements into technical solutions.
  • Follow Git/DevOps, CI/CD, coding standards and data governance practices.

Must-Have Skills

Azure Databricks | PySpark | Python | Advanced SQL | Apache Spark | ETL/ELT | Azure Data Factory | ADLS | Azure SQL/Oracle

Good to Have

  • Delta Lake / Unity Catalog
  • Azure Synapse
  • Spark performance tuning
  • Data Warehousing / Data Lakehouse
  • Kafka / Event Hub
  • Azure DevOps / CI-CD
  • Insurance / BFSI domain experience
  • Data archival / retention / purge experience

Skills Required

Project Azure Databricks Python Data Engineering Azure Data Lake Implementation And Integration Projects Azure Data Factory Oracle

Work Mode

Work from Office

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Orcapod Consulting Services logo
Orcapod Consulting Services

Consulting

Mumbai

RecommendedJobs for You

Meghaz Software Solutions logo

Data Engineer

Meghaz Software Solutions

Bengaluru

Independent Recruitment Consultant (freelancer) logo

Data Engineer

Independent Recruitment Consultant (freelancer)

India

People Tech Technology logo

Data Engineer

People Tech Technology

Hyderabad

WPP logo

Chennai

Krato Solutions logo

Data Engineer

Krato Solutions

Chennai

Applied Systems logo

Data Engineer

Applied Systems

Bengaluru

HP logo

Bengaluru