Data Engineer

Data Engineer – Azure / Microsoft Fabric

Role Summary

4–5 years of experience

What You’ll Do

• Build, deploy and manage

  end‑to‑end ETL / ELT pipelines

  using

  Azure Data Factory (ADF)

  ,

  Azure Databricks (ADB)

  /

  Microsoft Fabric

  .
• Ingest data from diverse sources, transform, clean and store it in

  Azure Data Lake / OneLake

  or

  Delta Lake / Lakehouse

  , enabling downstream analytics and reporting.
• Design and maintain robust

  data models, warehouse / lakehouse schemas

  , ensuring data integrity, reliability and performance.
• Write efficient data transformation and processing logic using

  PySpark, Python and/or Scala

  , optimizing for large‑scale data workloads.
• Collaborate with data scientists, analysts, product owners, and other stakeholders to understand data needs and deliver appropriate solutions.
• Implement data governance, quality, and security standards; ensure compliance and data reliability across data lifecycle.
• Apply version control and CI/CD practices to pipelines and infrastructure (e.g. Git / Azure DevOps), supporting seamless deployment, monitoring and maintenance.
• Troubleshoot, monitor, and optimize data pipelines to ensure performance, scalability and operational excellence.

Required Skills & Experience

• 4–5 years of hands-on experience

  as a Data Engineer working with

  Azure Data Factory (ADF)

  ,

  Azure Databricks / Microsoft Fabric

  , and data‑lake / lakehouse storage (Azure Data Lake / OneLake / Delta Lake).
• Strong programming skills in

  PySpark, Python

  , and/or

  Scala

  ; ability to write clean, efficient, maintainable code for large‑scale data processing.
• Proficiency in

  data modeling, data‑warehouse / lakehouse architecture and schema design

  .
• Solid understanding of ETL/ELT patterns, orchestration, scheduling and data pipeline lifecycle.
• Experience with

  MS SQL (or equivalent relational databases / data stores)

  for data storage or warehousing.
• Familiarity with

  version control (Git)

  and

  CI/CD pipelines

  for data engineering workflows.
• Problem-solving mindset, with ability to work on large datasets and meet data reliability, performance, and quality requirements.

Preferred / Nice‑to‑Have

• Exposure to

  event-driven or real-time data ingestion and processing

  (e.g. using messaging or streaming services).
• Familiarity with serverless or micro‑service style Azure components (e.g. Azure Functions, Logic Apps, Event Hub / Service Bus).
• Basic knowledge of reporting/BI tools (e.g. Power BI) — to aid end-to-end data-to-insight workflows.
• Experience with infrastructure‑as‑code / cloud‑infrastructure provisioning tools (e.g. Terraform / Bicep) and metadata/governance tools or processes.
• Experience or interest in building data governance, cataloging, lineage, and compliance standards.

Why You Might Be a Great Fit

• You enjoy working with large-scale data, solving complex data‑architecture challenges, and building data platforms that scale.
• You value writing clean, maintainable code and building pipelines that are robust, efficient, and reliable.
• You appreciate collaboration — working with analysts, data scientists, product teams to turn raw data into actionable insights.
• You stay updated on cloud-native data technologies, big data patterns, and best practices, and you take initiative to learn and implement new technologies as appropriate.

Bonus / Preferred Qualifications

• Certifications such as Azure Data Engineer Associate (or equivalent) or other Azure / cloud-data certifications
• Prior experience working in agile / scrum teams or global delivery environments
• Exposure to data governance, compliance, and security practices in enterprise data environments

Ready to make an impact with data? Apply now!