Azure Data Engineer

**Role Overview:** You will be working as a Senior Azure Data Engineer in the IT services and enterprise data engineering sector, delivering cloud-native analytics, ETL/ELT pipelines, and modern data platform implementations on Microsoft Azure for large enterprise customers. This is an on-site, hands-on engineering role supporting strategic data modernization initiatives across business domains. **Key Responsibilities:** - Design, build and maintain scalable ETL/ELT pipelines using Azure Data Factory and Azure Databricks to ingest, cleanse, and transform large datasets. - Develop PySpark and Python-based data processing jobs; optimize Spark workloads for throughput, latency and cost on Databricks. - Architect and manage enterprise data storage and warehousing solutions using ADLS Gen2, Azure Synapse Analytics, and Azure SQL Data Warehouse. - Implement CI/CD and infrastructure-as-code for data platform deployments using Azure DevOps and ARM/Terraform; manage release pipelines and automated testing. - Establish monitoring, alerting and observability for pipelines and data assets (Log Analytics, Application Insights, metrics) and drive data quality, lineage and security practices. - Collaborate with data scientists, analysts and cross-functional teams to translate business requirements into performant data solutions; mentor junior engineers and enforce engineering best practices. **Qualifications Required:** - 6+ years of experience in data engineering with significant hands-on work on Microsoft Azure. - Proven expertise implementing pipelines with Azure Data Factory and Azure Databricks. - Experience designing solutions in Azure Synapse Analytics and managing data in ADLS Gen2. - Strong programming skills in Python and PySpark; advanced SQL and query performance tuning. - Operational experience with CI/CD using Azure DevOps and infrastructure-as-code (ARM/Terraform). - Familiarity with data governance, security controls (RBAC, encryption), and production monitoring/alerting. If you are a hands-on Azure data engineer looking for an on-site role in Hyderabad or Chennai, with exposure to enterprise-scale cloud data projects and cross-functional teams, this opportunity is for you.,