Azure Data Engineer/Lead Azure Data Engineer

Job Summary:

We are seeking a skilled and detail-oriented Azure Data Engineer to join our data engineering team. The ideal candidate will have hands-on experience with Azure Data Factory, Azure Synapse or Microsoft Fabric, and strong programming skills in Python or PySpark. Proficiency in SQL and experience in designing and maintaining modern data pipelines and data lakes is essential.

Key Responsibilities:

• Design, build, and manage scalable data pipelines using Azure Data Factory (ADF).
• Develop and optimize data transformations using Azure Synapse Analytics or Microsoft Fabric.
• Write efficient and reusable code in Python or PySpark for data wrangling and processing.
• Create, maintain, and optimize complex SQL queries and stored procedures.
• Collaborate with data scientists, analysts, and business stakeholders to understand data needs.
• Ensure data accuracy, consistency, and security across pipelines and storage layers.
• Monitor pipeline performance and troubleshoot data issues in production environments.
• Participate in architectural discussions and propose scalable, secure data solutions on Azure

Required Skills and Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 37 years of experience in data engineering or related roles.
• Strong experience with Azure Data Factory (ADF) for ETL/ELT workflows.
• Proficiency in Azure Synapse Analytics and/or Microsoft Fabric.
• Solid coding skills in Python or PySpark for data processing and automation.
• Advanced knowledge of SQL including writing, optimizing, and troubleshooting queries.
• Experience with data modeling, data lakes, and data warehouse concepts.
• Familiarity with DevOps practices and CI/CD pipelines in data projects is a plus.
• Good communication skills and the ability to work in a collaborative, agile team environment.

Preferred Qualifications:

• Azure certifications (e.g., Azure Data Engineer Associate or Azure Fundamentals).
• Experience with Azure DevOps, Git, or other version control tools.
• Understanding of data governance, security, and compliance within Azure.