Job
Description
Role Overview: You will be working as a Senior Azure Data Engineer in an IT services and enterprise data engineering company that delivers cloud-native analytics, ETL/ELT pipelines, and modern data platform implementations on Microsoft Azure for large enterprise customers. This role is on-site and hands-on, supporting strategic data modernization initiatives across business domains. Key Responsibilities: - Design, build, and maintain scalable ETL/ELT pipelines using Azure Data Factory and Azure Databricks for ingesting, cleansing, and transforming large datasets. - Develop PySpark and Python-based data processing jobs, optimizing Spark workloads for throughput, latency, and cost on Databricks. - Architect and manage enterprise data storage and warehousing solutions using ADLS Gen2, Azure Synapse Analytics, and Azure SQL Data Warehouse. - Implement CI/CD and infrastructure-as-code for data platform deployments using Azure DevOps and ARM/Terraform, managing release pipelines and automated testing. - Establish monitoring, alerting, and observability for pipelines and data assets (Log Analytics, Application Insights, metrics), driving data quality, lineage, and security practices. - Collaborate with data scientists, analysts, and cross-functional teams to translate business requirements into performant data solutions, mentor junior engineers, and enforce engineering best practices. Qualifications Required: Must-Have: - 6+ years of experience in data engineering with significant hands-on work on Microsoft Azure. - Proven expertise in implementing pipelines with Azure Data Factory and Azure Databricks. - Experience in designing solutions in Azure Synapse Analytics and managing data in ADLS Gen2. - Strong programming skills in Python and PySpark, advanced SQL knowledge, and query performance tuning. - Operational experience with CI/CD using Azure DevOps and infrastructure-as-code (ARM/Terraform). - Familiarity with data governance, security controls (RBAC, encryption), and production monitoring/alerting. Preferred: - Microsoft Certified: Azure Data Engineer Associate. - Experience with streaming platforms (Azure Event Hubs, Kafka) and Delta Lake. - Background in analytics/visualization platforms such as Power BI or Synapse SQL for reporting. (Note: The JD does not provide any additional details of the company) Role Overview: You will be working as a Senior Azure Data Engineer in an IT services and enterprise data engineering company that delivers cloud-native analytics, ETL/ELT pipelines, and modern data platform implementations on Microsoft Azure for large enterprise customers. This role is on-site and hands-on, supporting strategic data modernization initiatives across business domains. Key Responsibilities: - Design, build, and maintain scalable ETL/ELT pipelines using Azure Data Factory and Azure Databricks for ingesting, cleansing, and transforming large datasets. - Develop PySpark and Python-based data processing jobs, optimizing Spark workloads for throughput, latency, and cost on Databricks. - Architect and manage enterprise data storage and warehousing solutions using ADLS Gen2, Azure Synapse Analytics, and Azure SQL Data Warehouse. - Implement CI/CD and infrastructure-as-code for data platform deployments using Azure DevOps and ARM/Terraform, managing release pipelines and automated testing. - Establish monitoring, alerting, and observability for pipelines and data assets (Log Analytics, Application Insights, metrics), driving data quality, lineage, and security practices. - Collaborate with data scientists, analysts, and cross-functional teams to translate business requirements into performant data solutions, mentor junior engineers, and enforce engineering best practices. Qualifications Required: Must-Have: - 6+ years of experience in data engineering with significant hands-on work on Microsoft Azure. - Proven expertise in implementing pipelines with Azure Data Factory and Azure Databricks. - Experience in designing solutions in Azure Synapse Analytics and managing data in ADLS Gen2. - Strong programming skills in Python and PySpark, advanced SQL knowledge, and query performance tuning. - Operational experience with CI/CD using Azure DevOps and infrastructure-as-code (ARM/Terraform). - Familiarity with data governance, security controls (RBAC, encryption), and production monitoring/alerting. Preferred: - Microsoft Certified: Azure Data Engineer Associate. - Experience with streaming platforms (Azure Event Hubs, Kafka) and Delta Lake. - Background in analytics/visualization platforms such as Power BI or Synapse SQL for reporting. (Note: The JD does not provide any additional details of the company)
