Data Platform Engineer

Job Description: Azure DevOps & Data Platform Engineer

Job Title:

Experience:

Job Summary

We are looking for an experienced Azure DevOps & Data Platform Engineer with strong expertise in Azure DevOps, CI/CD pipeline automation, Terraform Infrastructure as Code (IaC), Azure Synapse Analytics, and Azure Databricks. The candidate will be responsible for managing end-to-end deployments, automating infrastructure provisioning, supporting data platform administration, and ensuring secure and efficient deployments across multiple environments.

Key Responsibilities

• Design, develop, and maintain CI/CD pipelines for Azure Synapse Analytics and Databricks applications using Azure DevOps.
• Manage end-to-end application and infrastructure deployments across Dev, UAT, Pre-Production, and Production environments.
• Automate deployments using Azure DevOps YAML pipelines, scripting, and automation frameworks.
• Develop, maintain, and implement reusable Terraform modules for Azure infrastructure provisioning and management.
• Support Azure Databricks administration, including workspace configuration, access management, service principals, and groups.
• Manage Azure Synapse deployment activities and integrate Synapse objects and configurations into CI/CD pipelines.
• Perform Azure administration activities, including RBAC, Key Vault, Storage, networking, resource access, and platform configuration.
• Troubleshoot pipeline failures, deployment issues, access-related problems, and Azure platform incidents.
• Develop automation scripts to reduce manual effort and improve operational efficiency.
• Collaborate with Data Engineering, Application, DevOps, and Platform teams to enable reliable and secure deployments.
• Ensure compliance with enterprise security, governance, change management, and deployment approval standards.
• Continuously improve CI/CD processes, infrastructure automation, and deployment practices.
• Maintain technical documentation for pipelines, Terraform modules, deployment processes, and platform administration.

Required Technical Skills

• Strong hands-on experience with

  Azure DevOps and CI/CD pipelines

  .
• Expertise in

  Azure DevOps YAML pipelines

  and deployment automation.
• Strong experience with

  Terraform and Infrastructure as Code (IaC)

  .
• Hands-on experience with

  Azure Databricks administration

  .
• Experience with

  Azure Synapse Analytics deployment and administration

  .
• Good understanding of Azure services, including RBAC, Key Vault, Storage, networking, and access management.
• Proficiency in scripting and automation.
• Experience managing deployments across multiple environments.
• Strong troubleshooting, problem-solving, and documentation skills.

Preferred Skills

• Experience with enterprise-scale Azure data platforms.
• Knowledge of security, governance, and access-control best practices.
• Experience implementing reusable infrastructure modules and standardized deployment frameworks.
• Ability to collaborate effectively with cross-functional technical teams.

Education

Bachelors degree in Computer Science, Information Technology, Engineering, or a related discipline.