Azure Data Engineer

*** We are looking for ETL Developer with strong expertise in Python, Azure Data Engineering services who can join us immediately at our Bangalore Office***

Experience : 7-10 years

Job Overview :

Role & responsibilities

• We are looking for an experienced ETL Developer with strong expertise in Python, Azure Data Engineering services, and data integration frameworks. The ideal candidate will design, build, and optimize scalable ETL/ELT pipelines to support enterprise data needs.

• Key Responsibilities

• Design, develop, and maintain ETL/ELT pipelines using Python, Azure Data Factory, and Azure Databricks.

• Build robust data ingestion workflows from various sources (APIs, flat files, databases, cloud systems).

• Work with Azure services including Azure Data Lake Storage (ADLS), Azure SQL Database, Synapse Analytics, Azure Functions, and Key Vault.

• Optimize ETL performance, implement error handling, and ensure data quality & reliability.

• Develop reusable Python components/modules for data transformations.

• Implement CI/CD pipelines for data workflows using Azure DevOps or Git.

• Collaborate with data architects, analysts, and business stakeholders to understand data requirements.

• Ensure data security, compliance, and governance standards across ETL pipelines.

• Conduct root-cause analysis and troubleshoot data pipeline issues.

• Prepare technical documentation for workflows, code, and architecture.

• Required Skills & Qualifications:

• 57 years of overall experience in data engineering or ETL development.

• Strong hands-on experience with Python, including libraries like Pandas, PySpark, NumPy.

• Proficiency in Azure Data Factory (ADF) for orchestrating ETL workflows.

• Experience with Azure Databricks, PySpark, or other distributed data processing frameworks.

• Solid understanding of SQL, stored procedures, and performance tuning.

• Experience working with Azure cloud data components (ADLS, Synapse, Azure SQL, Azure Functions).

• Good understanding of data modelling, data warehousing, and design patterns.

• Experience integrating on-premise and cloud data sources.

• Knowledge of version control systems (Git) and DevOps pipelines.

• Strong analytical and troubleshooting skills.

• Excellent communication and documentation abilities.

• Good to Have:

• Experience with Delta Lake and lakehouse architectures.

• Exposure to CI/CD using Azure DevOps.

• Knowledge of REST APIs and integration patterns.

• Experience with data governance tools .