Azure & Big Data - Lead

Iris Software has been a trusted software engineering partner to several Fortune 500 companies for over three decades. We help clients realize the full potential of technology-enabled transformation by bringing together a unique blend of domain knowledge, best-of-breed technologies, and experience executing essential and critical application development engagements.

www.irissoftware.com

Title- Azure & Big Data - Lead

Location- Noida/Gurgaon/Pune

Notice: 15 Days OR Immediate joiners only

Mode- Hybrid

Shift: 1:00 PM- 10:00 PM IST

Job Summary:

We are seeking a highly skilled and experienced Lead Data Engineer to join our data engineering team. The ideal candidate will have a strong background in designing and deploying scalable data pipelines using Azure technologies, Spark, Flink, and modern data lakehouse architectures. This role demands hands-on technical expertise, leadership in managing offshore teams, and a strategic mindset to drive data-driven decision-making across financial and regulatory domains.

Key Responsibilities:

•    Design, develop, and deploy scalable batch and streaming data pipelines using PySpark, Flink, Scala, SQL, and Redis.•    Lead migration of complex on-premise workflows to Azure cloud ecosystem (Databricks, ADLS, Azure Data Factory), optimizing infrastructure and deployment processes.•    Implement performance tuning strategies to reduce job runtimes and enhance data reliability, including optimization of Unity Catalog tables.•    Collaborate with product stakeholders to deliver high-priority data features and ensure alignment with business goals.•    Manage and mentor an 8-member offshore team, fostering best practices in data engineering and agile development.•    Conduct internal training sessions on modern data architecture, cloud-native deployments, and data engineering best practices.

Certifications (Good to have):

•    Databricks Certified: Data Engineer Associate, Lakehouse Fundamentals•    Microsoft Certified: Azure Fundamentals (AZ-900), Azure Data Fundamentals (DP-900)

Preferred Qualifications:

ankur.kashyap@irissoftware.com