Azure Data Engineer

Work Location:

Experience:

Mandatory:

Mandatory Skills

• Bachelor's degree in Computer Science or related field, or equivalent with minimum 4+ years of relevant experience.
• Minimum 3 years of consulting or client delivery experience in Azure-based data engineering.
• At least 1 year of hands-on experience developing data ingestion, processing, and analytics pipelines for big data, SQL-based systems, and data warehousing solutions such as Synapse, Azure Databricks, and Microsoft Fabric.
• Strong experience with Azure services including Fabric, OneLake, ADLS, Azure Data Factory, Azure Functions, and other Microsoft Fabric components.
• Practical experience (1+ years) with Big Data technologies such as Fabric, Databricks, Python, SQL, ADLS/Blob, PySpark/Spark SQL.
• Minimum 1 year of experience working with RDBMS.
• Good understanding of Big Data file formats and compression techniques.
• Experience using development tools like Azure DevOps, Visual Studio Team Services, Git, etc.

Roles & Responsibilities

• Design, build, and maintain data infrastructure using Azure cloud services.
• Develop and manage data pipelines and integrate data from multiple sources.
• Implement data security, privacy, and governance best practices.
• Monitor, troubleshoot, and optimize data flows for performance and cost efficiency.

Preferred Skills

• Experience building and deploying ETL solutions using ADF, Notebooks, Synapse Analytics, Azure Functions, and Microsoft Fabric.
• Hands-on expertise in developing ETL pipelines in Microsoft Fabric, including medallion architecture, metadata-driven ingestion, data quality frameworks, and SCD implementations using Fabric Notebooks or Databricks.
• Knowledge of Microsoft Co-pilot, GenAI basics, and relevant industry use cases.
• Microsoft certifications (e.g., DP-600, DP-203, DP-900, AI-102, AI-900) are an added advantage.
• Working knowledge of Power BI for reports, dashboards, and business insights.
• Understanding of Azure RBAC, IAM, access controls, and security standards.
• Familiarity with Microsoft's technology roadmap and evolving industry trends.