Azure DevOps engineer with Data Engineering capabilities

Job Title:

Experience:

Location:

Employment Type:

Technology:

Key Responsibilities:

Job Description:

• Experience working with cloud-based database platforms such as Azure Synapse Analytics, Azure SQL Database, and Snowflake to enable scalable data warehousing and analytics solutions.
• Design and develop scalable data pipelines leveraging Azure Data Factory, Azure Databricks, and Synapse Analytics for efficient data ingestion and transformation.
• Implement ETL workflows to extract data from diverse sourcesincluding relational databases, REST APIs, file systems, real-time streams, and Change Data Capture (CDC)—and load it into Azure Data Lake Storage.
• Monitor data pipeline health and implement performance tuning and cost optimization measures to ensure reliability and efficiency.
• Administer cloud infrastructure in Azure environments, focusing on networking, security configurations, monitoring setups, and cost management.
• Lead cloud migration projects, transitioning existing workloads to Azure with attention to architectural best practices and operational continuity.
• Develop and maintain infrastructure-as-code (IaC) and automate deployment processes using Azure DevOps pipelines, ensuring repeatable and reliable application and infrastructure delivery.
• Manage source control, branching strategies, and repository administration using Azure DevOps Repos and GitLab.
• Utilize containerization technologies such as Docker for packaging, deployment, and orchestration of applications, ensuring security and scalability.
• Write and maintain automation scripts and tooling using languages including PowerShell and Python, supporting deployment, monitoring, and configuration tasks.
• Build and manage CI/CD workflows integrating code repositories, automated testing, security scans, and deployment across multiple environments.
• Leverage Azure DevOps tools including build and release pipelines, work item tracking, and REST APIs to support the software development lifecycle and team collaboration.

Required Skills:

• 4–8 years’ experience in Data Engineering or related roles.
• Expertise in Azure Databricks, Azure Data Factory, and Synapse Analytics.
• Proficient in Python scripting and advanced SQL query writing and optimization.
• Experience with Azure Data Lake Storage and data warehousing concepts (star/snowflake schemas).
• Familiarity with CI/CD processes in data engineering environments.
• Hands-on experience with Delta Lake and distributed processing frameworks like Spark; Scala is a plus.
• Working knowledge of BI tools such as Power BI, Tableau, or Looker.
• Strong command of Azure DevOps for source control and pipeline automation.
• Understanding of cloud data security and compliance.
• Excellent problem-solving and communication skills.
• Leadership experience in managing or mentoring engineering teams preferred.