Tech Lead_ Azure Data Factory _ Bangalore

JD Azure Eng, Microsoft Fabric and Databricks

Tech Hub

Information Technology – Application & Solution Development

Role Title

Azure Eng, Microsoft Fabric and Databricks

Grade

Manager – L3 support

Position Overview

Seeking an experienced and visionary Manager to lead our Azure Engineering team, focusing on Microsoft Fabric and Databricks platforms. In this role, candidate will be responsible for driving the design, implementation, and optimization of cloud data engineering solutions that leverage Microsoft Fabric, Azure services, and Databricks. Leading a team of engineers and collaborate closely with data scientists, architects, and business stakeholders to build scalable, secure, and performant data pipelines and analytics platforms

This role involves working closely with IT teams and stakeholders to design and implement database solutions that align with business needs

Key Relationships

• Project Managers
• Business Analyst
• IT Security Teams
• DevOp Engineer
• Application Support
• Application Development

Main Accountabilities

• Lead, mentor, and grow a high-performing engineering team

  specializing in Azure Cloud, Microsoft Fabric

  , and

  Databricks technologies

  .
• Define and execute the cloud data platform roadmap, aligned with business objectives and technology best practices.
• Architect scalable, resilient, and secure data solutions using Microsoft Fabric (including One Lake, Data Factory, Synapse, etc.) and Databricks on Azure.
• Oversee the design and

  implementation of ETL/ELT pipelines, data lakes

  , and analytics platforms to support advanced analytics, machine learning, and BI initiatives.
• Collaborate with data architects, product owners, and business stakeholders to translate requirements into technical solutions.
• Drive adoption of

  DevOps practices, automation, CI/CD pipelines

  , and infrastructure as code for cloud data engineering workflows.
• Monitor and improve performance, reliability, and cost optimization of data engineering solutions.
• Ensure

  compliance with data governance, security policies

  , and regulatory requirements.
• Stay current with industry trends in cloud data engineering, Azure services, Microsoft Fabric updates, and Databricks innovations. Advocate for continuous technical improvement.
• Manage vendor relationships and coordinate with Microsoft support as needed.
• Provide technical oversight, code reviews, and promote best practices within the team

Critical Skills,

Knowledge, and Experience

• Cloud Data Engineering Expertise

• Deep knowledge of

  Azure Data Services such as Azure Data Factory

  ,

  Databricks

  , Synapse Analytics, Azure Blob Storage, and

  Azure Data Lake

  Storage.
• Strong experience with Databricks on Azure, including Spark, Delta Lake, and associated data engineering patterns.

• Microsoft Fabric Proficiency

• Practical experience with

  Microsoft Fabric

  components (OneLake, Data Factory integration, Synapse, and Power BI integration).
• Ability to architect solutions leveraging Fabric’s unified data and analytics capabilities.

• Architecture & Solution Design

• Capability to design scalable, resilient, secure, and cost-effective cloud data platforms.
• Strong understanding of data pipeline architectures (ETL/ELT), data lakes, and analytics workflows.

• Programming & Automation

• Proficiency with programming/scripting languages like Python, SQL, Scala for data engineering tasks.
• Experience with Infrastructure as Code (Terraform, ARM templates) and CI/CD pipelines (Azure DevOps, GitHub Actions)
• Ability to analyze and solve complex technical problems.
• Excellent communication and collaboration skills.

Key Personal Attributes

• Curiosity

  : A natural curiosity and eagerness to learn, explore new ideas, and see past the status quo.

• Collaboration:

  A natural collaborator, suited to work in a collaborative culture with a diverse and talented team that values collaboration, constructive challenging and mutual respect. •

• Challenge:

  Demonstrates the capability to question and challenge ideas, decisions, and processes in a constructive manner, fostering a culture of continuous improvement and innovation while maintaining respect and professionalism in all interactions.

• Value Driven:

  Demonstrates a strong commitment to ethical principles and organisational values, ensuring that all actions and decisions align with the company's mission and integrity standards.
• Excellent attention to detail.
• Proactive.
• Adaptability in dynamic environment.

Additional information

Azure Certified Solution Architect