Lead Data Engineer

Key Responsibilities:

Team Leadership:

Lead and mentor a team of Azure Data Engineers, providing technical guidance and support.

Foster a collaborative and innovative team environment.

Conduct regular performance reviews and set development goals for team members.

Organize training sessions to enhance team skills and technical capabilities.

Azure Data Platform:

Design, implement, and optimize scalable data solutions using Azure data services such as Azure Databricks, Azure Data Factory, Azure SQL Database, and Azure Synapse Analytics.

Ensure data engineering best practices and data governance are followed.

Stay up-to-date with Azure data technologies and recommend improvements to enhance data processing capabilities.

Data Architecture:

Collaborate with data architects to design efficient and scalable data architectures.

Define data modeling standards and ensure data integrity, security, and governance compliance.

Project Management:

Work with project managers to define project scope, goals, and deliverables.

Develop project timelines, allocate resources, and track progress.

Identify and mitigate risks to ensure successful project delivery.

Collaboration & Communication:

• Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to deliver data-driven solutions.
• Communicate effectively with stakeholders to understand requirements and provide updates.

Qualifications:

Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.

Proven experience as a Team Lead or Manager in data engineering.

Extensive experience with Azure data services and cloud technologies.

Expertise in Azure Databricks, PySpark, and SQL.

Strong understanding of data engineering best practices, data modeling, and ETL processes.

Experience with agile development methodologies.

Certifications in Azure data services (preferred).

Preferred Skills:

Experience with big data technologies and data warehousing solutions.

Familiarity with industry standards and compliance requirements.

Ability to lead and mentor a team.