Azure Data Engineer

Azure Data Engineer (4-7 yrs dedicated exp.)

Azure Databricks, Logic Apps, Azure Storage Services, Azure Data Factory (ADF), and Medallion Architecture

Key Responsibilities:

• Design, configure, and maintain

  data ingestion and processing environments

  using

  Azure Data Lake, Databricks, Logic App and ADF

  .
• Well versed to design all layers of Medallion architecture.
• Implement

  ETL/ELT workflows

  for batch and real / near real-time data processing to load, transform and prepare aggregated data across all layers Bronze, Silver and Gold.
• Apply

  Medallion Architecture principles

  to organize and transform raw data into curated and consumable datasets.
• Experienced in Delta Lake design and implementation
• Hands-on experience in data cleansing, loading, and processing for staging and data warehouse environments using ETL pipelines
• Collaborate with teams to develop

  data pipelines, notebooks, and dashboards

  to support analytics and reporting.
• Automate data workflows and integrations using

  Azure Logic Apps

  and other orchestration tools.
• Ensure

  data quality, reliability, and performance

  across all layers of the data platform.
• Assist in troubleshooting and optimization of existing pipelines or delta lake for efficiency and scalability.
• Document solutions, best practices, and maintain

  environment configuration standards

  .

Required Skills & Experience:

• Strong experience with

  Azure Data Lake, Azure Databricks, Logic Apps, Data warehouse, Azure key Valult and Azure data factory.

• Proficiency in

  PySpark, Spark SQL, and ETL/ELT development

  .
• Understanding of

  Medallion Architecture, Delta Lake

  and its implementation in Azure Databricks.
• Experience with

  data modelling, transformations, and pipeline orchestration

  .
• Familiarity with

  data governance, quality checks, and performance optimization

  .
• Good problem-solving skills and ability to work

  independently and collaboratively

  .

Good to have Skills:

• Knowledge of

  Azure DevOps/GitHub

  for CI/CD integration.
• Knowledge on SCALA and Python
• Data platform related environment setup and configuration
• Understanding of

  business intelligence tools

  like Power BI or Tableau.