Data Engineer

About the Role

We are looking for a highly experienced Data Engineer with strong expertise in building and managing ETL pipelines on Azure. This is a contract role focused on hands-on delivery, where Azure Data Factory (ADF) is the primary orchestration tool and Python is used extensively for data processing and transformations.

Key Responsibilities

• Design, build, and maintain scalable ETL pipelines using Azure Data Factory (ADF)
• Develop and maintain Python-based data transformation logic
• Ingest data from APIs, databases, and flat files into Azure data platforms
• Implement data validation, quality checks, and error handling within pipelines
• Optimize ETL workflows for performance, reliability, and cost efficiency
• Collaborate with internal stakeholders to understand data requirements and deliver reliable datasets
• Troubleshoot and resolve data pipeline issues in production environments

Must-Have Skills

• 10+ years of experience as a Data Engineer with strong ETL focus
• Deep hands-on experience with Azure Data Factory (ADF)
• Python as the primary language for ETL and data processing
• Strong understanding of ETL / ELT concepts and data workflows
• Experience working with Azure data services (ADLS, Databricks, Synapse)
• Strong SQL skills and experience with relational databases
• Experience using Git for version control

Good to Have

• Experience with Databricks / PySpark
• Exposure to Airflow or similar orchestration tools
• Familiarity with Docker or Kubernetes
• Experience with Snowflake or PostgreSQL