Manager

Role Overview

Manager – Azure Data Engineer

large team of data engineers

Key Responsibilities

• Leadership & Team Management
• Lead and manage a team of 10–16 data engineers, ensuring high performance and engagement.
• Set clear goals, monitor progress, and provide coaching and mentorship to team members.
• Foster an inclusive and collaborative environment that promotes knowledge sharing and continuous improvement.
• Manage resource allocation, workload balancing, and succession planning.
• Technical Delivery
• Perform and oversee data transformation and integration projects using Azure Databricks, Azure Data Factory, and Python/PySpark.
• Design and manage scalable data processing pipelines and workflows to support analytics and audit requirements.
• Apply advanced concepts such as partitioning, optimization, and performance tuning for efficient data processing.
• Drive integration of ERP systems (SAP, Oracle, Microsoft Dynamics) with Azure-based solutions.
• Debug, optimize, and resolve issues in large-scale data workflows, proposing effective solutions with minimal guidance.
• Data Handling & Workflow Development
• Demonstrate advanced knowledge of Azure cloud services, including Azure Databricks, Data Factory, Data Lake Storage, and related technologies.
• Utilize tools such as Alteryx and PowerBI for data analysis and visualization.
• Apply understanding of audit processes, financial data structures, and risk assessment routines.
• Explore and apply Azure AI services to enhance business processes.
• Performance Optimization & Debugging
• Debug, optimize, and tune performance for large-scale data processing workflows.
• Resolve issues with minimal guidance and propose effective solutions.
• Stakeholder Engagement
• Act as a primary point of contact for audit engagement teams and client IT teams.
• Communicate effectively with business leaders, translating technical solutions into business value.
• Build strong relationships across global teams to enable seamless delivery
• Stakeholder Engagement
• Act as a primary point of contact for audit engagement teams and client IT teams.
• Communicate effectively with business leaders, translating technical solutions into business value.
• Build strong relationships across global teams to enable seamless delivery.
• Domain Expertise (Added advantage)
• Experience with General Ledger/Sub-Ledger analysis and development of risk assessment or substantive routines for Audit/Internal Audit (Big 4 experience preferred).
• Additional Skills
• Working knowledge of KQL (Kusto Query Language) and Azure REST APIs is a plus.
• Enthusiasm to explore and apply Azure AI services in business processes.
  

Responsibilities

Technical Skills

• Minimum 8-12 years of experience in data engineering, with deep expertise in Azure technologies.
• Proficiency in Azure, DataBricks Notebooks, SQL, Python or Pyspark notebooks development.
• Knowledge on any ERP and about the dataflows in ERP
• Strong knowledge of ETL tools and processes.
• Hands-on experience with Azure Databricks, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS)
• Comprehensive knowledge of Azure cloud services.
• Experience with Databricks notebooks for building transformations and creating tables
• Experience in Alteryx and PowerBI for data analysis and visualization purpose.
• Microsoft Fabric and Azure AI services is an added advantage
• Understanding of audit processes, financial data structures, and risk assessment routines.
  

Enabling Skills

• Excellent analytical, problem solving and troubleshooting abilities
• Critical thinking: able to look at numbers, trends and data and come to new conclusions based on findings
• Attention to detail and good team player
• Quick learning ability and adaptability
• Willingness and capability to deliver within tight timelines
• Effective communication skills
• Flexible to work timings and willingness to work in different projects/technologies
• Collaborate with business stakeholders to understand data requirements and deliver solutions
  

Leadership Qualities

• Visionary mindset with ability to align team goals to organizational objectives.
• Strong people management skills, fostering growth and engagement.
• Ability to influence and collaborate across diverse teams and geographies.
  

Qualifications

Education Requirements

• B. Tech/B.E/MCA (Computer Science / Information Technology)