Senior Data Engineer

Role Summary

Senior Azure Data Engineer

Key Responsibilities

• Design and develop scalable ETL/ELT pipelines using Azure Data Factory and Azure Synapse Pipelines
• Implement error handling mechanisms and optimize pipeline performance by identifying and resolving bottlenecks
• Work with Azure Databricks (PySpark), Azure Data Lake Storage (ADLS Gen 2), Azure Synapse, and Microsoft Fabric
• Collaborate with architects to design and implement Cloud Data Warehouse solutions
• Develop reporting framework layers for Power BI and Tableau
• Apply big-data processing approaches and schema-on-read methodologies
• Write efficient code in Python (PySpark) and SQL for data transformation and processing

Required Skills

• 6-10 years of hands-on experience with Azure data services
• Strong expertise in Azure Data Factory, Azure Databricks (PySpark), ADLS Gen 2, Azure Synapse, and Microsoft Fabric
• Proficiency in Python (PySpark) and SQL
• Experience designing and implementing ETL/ELT pipelines with error handling and performance tuning
• Knowledge of Cloud Data Warehouse design and implementation
• Understanding of big-data processing and schema-on-read methodologies
• Experience designing reporting frameworks for BI tools

Good-to-have Skills

• Power BI DAX development experience
• Exposure to Tableau
• Performance optimization and troubleshooting skills

Additional Information

• Shift Timings: 11:00 AM to 8:00 PM IST (Candidate must be flexible for 4-hour overlap with US hours)
• Work Mode: Hybrid – 2-3 days per week from Pune office
• Project Duration: 6 months (Contract to Hire)
• Immediate to 5 weeks notice period preferred

#AzureDataEngineer #DataEngineering #AzureDataFactory #AzureDatabricks #PySpark #AzureSynapse #MicrosoftFabric #CloudDataWarehouse #ETLPipelines #BigData #PowerBI #Pune #HybridJob #C2H #DataEngineeringJobs #HiringNow