Azure Data Engineer

6 - 11 years

Hyderabad Pune Bengaluru

Posted:4 days ago

Job Description

About the Role

We are looking for an experienced and passionate Azure Data Engineer to join our team at Capgemini. You will work with leading global brands to design, implement, and optimize modern data solutions using Microsoft Azure cloud services.

Key Responsibilities

  • Design, develop, and maintain end-to-end data ingestion, transformation, and processing pipelines using Azure Data Factory (ADF) and Azure Databricks (ADB).
  • Develop scalable ETL/ELT solutions to integrate data from multiple sources into Azure data platforms.
  • Build and optimize data processing frameworks using PySpark, Python, Scala, and Hive within Azure Databricks environments.
  • Implement and manage enterprise-scale data warehousing solutions using Azure SQL Database, Azure SQL Data Warehouse, and Azure Synapse Analytics.
  • Collaborate with business analysts, architects, and stakeholders to gather requirements and translate them into technical solutions.
  • Ensure data quality, data governance, security, and compliance standards are maintained across all data assets.
  • Perform performance tuning, query optimization, and troubleshooting of large-scale data processing workloads.
  • Design, build, and support distributed data workflows and real-time/batch processing solutions.
  • Develop and maintain CI/CD pipelines for data engineering applications using Azure DevOps and related tools.
  • Support cloud migration initiatives and modernization of legacy data platforms to Azure.
  • Create technical documentation, deployment procedures, and operational support guides.
  • Participate in code reviews and follow industry best practices for software engineering and data architecture.

Required Skills & Experience

Primary Skills (Mandatory)

Candidates must have strong hands-on experience in at least one of the following:

  • Azure Data Factory (ADF)

  • Azure Databricks (ADB)

Core Technical Skills

  • Strong experience with Azure Databricks and Azure Data Factory

  • Expertise in designing ETL/ELT pipelines and data integration solutions

  • Hands-on experience with:

    • Azure SQL Database

    • Azure SQL Data Warehouse

    • Azure Synapse Analytics

  • Proficiency in:

    • Python

    • PySpark

    • Scala

    • Hive


  • Experience working with large-scale structured and unstructured datasets
  • Strong understanding of data warehousing concepts and dimensional modeling
  • Experience in CI/CD implementation and deployment automation in Azure environments
  • Knowledge of Azure DevOps, Git, and version control practices
  • Understanding of cloud-native architecture, security, and monitoring best practices

Preferred Skills

  • Experience with Delta Lake and Spark optimization techniques
  • Knowledge of Azure Data Lake Storage (ADLS Gen2)
  • Exposure to real-time data processing and streaming solutions
  • Azure certifications related to Data Engineering or Cloud Technologies
  • Experience working in Agile/Scrum environments

Skills Required

Pyspark Azure Databricks Azure Data Factory Microsoft Fabric SQL Factory Fabric Microsoft Azure

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Work Mode

Hybrid

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Capgemini logo
Capgemini

IT Services and IT Consulting

Paris France

RecommendedJobs for You

Movate Technologies logo

Azure Data Engineer

Movate Technologies

Bengaluru

I

Azure Data Engineer

Infobyd software solution pvt ltd

Mumbai

Atem Software Solutions logo

Azure Data Engineer

Atem Software Solutions

Bengaluru

Hyderabad, Pune, Bengaluru

L

Azure Data Engineer

Labham PPPB Infrareality

Mumbai

Tquanta Technologies logo

Azure Data Engineer

Tquanta Technologies

Bengaluru