Job Description – Senior Data Engineer (Azure Focused)
Experience Level: 6 -10 Yrs
Location: Hyderabad
About the Role
We are seeking Senior Data Engineers with strong expertise in Microsoft Azure and modern data engineering practices. In this role, you will design, build, and optimize scalable data pipelines and solutions that empower business teams with timely, trusted, and actionable insights. You will play a key role in shaping our data ecosystem, ensuring performance, reliability, and governance across the data lifecycle.
Key Responsibilities
-
Design, build, and manage modern data pipelines on Azure using services such as Azure Data Factory, Synapse, Databricks, and Azure Data Lake.
-
Develop scalable ETL/ELT frameworks and integrate structured/unstructured data from diverse sources.
-
Implement data quality, security, and governance best practices across pipelines.
-
Optimize data workflows for performance, scalability, and cost efficiency.
-
Collaborate with data architects, data scientists, and business analysts to enable advanced analytics and AI/ML use cases.
-
Leverage CI/CD and DevOps practices to automate deployment and monitoring of data solutions.
-
Mentor junior engineers, share best practices, and contribute to a culture of continuous improvement.
Required Skills & Experience
-
6–10 years of experience in Data Engineering, with at least 3+ years on Azure ecosystem.
-
Hands-on expertise in:
-
Azure Data Factory, Azure Synapse, Azure Databricks, Azure Data Lake, Azure SQL.
-
Data modeling, SQL, Python, PySpark, and Delta Lake.
-
CI/CD (Azure DevOps/GitHub), Infrastructure as Code (Terraform/ARM/Bicep).
-
Strong understanding of data governance, data security, and performance optimization.
-
Experience with real-time data streaming (Kafka/Event Hubs/Stream Analytics) is a plus.
-
Familiarity with modern data architectures (Data Lakehouse, Medallion Architecture, Lakehouse with Delta).
-
Excellent problem-solving skills, ability to work in agile, cross-functional teams, and strong communication skills.
Good to Have
-
Exposure to AI/ML pipelines and MLOps integration.
-
Knowledge of Power BI/DAX for data consumption layer.
-
Experience with multi-cloud data integration (AWS/GCP + Azure).