Lead Data Engineer

Role & responsibilities

Project Role & Description

Lead Data Engineer

Primary Key Skills

• Databricks Expertise

  : 3+ years of experience, including Unity Catalog
• Databricks certifications preferred

• SQL/T-SQL Mastery

  : Advanced query development and optimization

• Leadership Experience

  : 3+ years managing and mentoring technical teams

• Data Warehousing

  : 7+ years in data modeling, cleansing, mapping, validation, and ETL/ELT development

• Programming

  : Strong proficiency in Python

• DevOps & Version Control

  : Experience with Azure DevOps (CI/CD) and GitHub

• Detail Orientation

  : Exceptional organizational skills and commitment to data accuracy

• Project Management

  : Proven ability to lead teams and deliver complex projects on time

• Bonus Skills:

• Experience with SAP data
• Familiarity with API/JSON/XML data sources
• Understanding of Microsoft Fabric and Power BI

Key Responsibilities

• Lead and manage a team of data engineers, providing technical guidance, performance feedback, and career development support
• Foster a high-performing team culture focused on accountability, innovation, and continuous learning
• Define team goals and align engineering efforts with business priorities and timelines
• Collaborate with business stakeholders to gather and analyze data requirements
• Design and maintain data models, ETL pipelines, and ingestion/extraction workflows
• Administer ETL jobs and implement robust failure recovery mechanisms
• Drive recruitment and onboarding of new engineering talent
• Ensure data quality, integrity, and consistency across all solutions
• Partner with data scientists, analysts, and cross-functional teams to deliver actionable insights
• Operate within an agile development framework using Azure DevOps sprints
• Evaluate new data sources and define optimal ingestion strategies for the Data Lake
• Enforce data governance policies and industry best practices for security and compliance
• Conduct rigorous data quality testing for all new developments
• Demonstrate ownership and initiative in resolving challenges and driving project success
• Support the growth of junior engineers through coaching and knowledge sharing
• Stay current with emerging technologies and enhancements within the existing toolset
• Sense of ownership. Engages domain experts and team members to work through challenges to ensure timely project delivery. Self Starter.
• Communicate effectively in both written and verbal formats; fluency in English required