AI DevOps Engineer

Experience:

Location:

Role Type:

Role Overview

We are looking for an AI DevOps Engineer with strong experience in DevOps and MLOps/LLMOps to build, automate, and manage AI delivery platforms. The ideal candidate will be responsible for CI/CD pipelines, cloud infrastructure, AI deployment workflows, monitoring, security, and production readiness.

Key Responsibilities

• Design and maintain CI/CD pipelines for AI applications, models, prompts, and agents.
• Implement Infrastructure as Code (IaC) using Terraform or Azure Bicep.
• Deploy and manage AI solutions using Azure OpenAI and Microsoft Foundry.
• Manage containerized applications using Docker and Kubernetes.
• Implement model and prompt versioning, automated evaluation, deployment gates, and rollback mechanisms.
• Set up monitoring, logging, telemetry, and performance tracking for AI workloads.
• Ensure secure deployments through secrets management, access controls, and policy enforcement.
• Optimize cloud infrastructure and AI workloads for cost, scalability, and reliability.
• Develop operational runbooks, deployment documentation, and production handover procedures.

Required Skills

• 6+ years of experience in DevOps/DevSecOps, including 2+ years in MLOps/LLMOps.
• Hands-on experience with Azure DevOps or GitHub Actions.
• Experience with Azure OpenAI and Microsoft Foundry deployment workflows.
• Strong Python scripting and automation skills.
• Proficiency in Terraform/Bicep, Docker, and Kubernetes.
• Understanding of AI model, prompt, and agent versioning and automated evaluation.
• Experience with monitoring, telemetry, secrets management, rollback strategies, and FinOps.
• Strong understanding of cloud security, CI/CD best practices, and production deployment processes.

Deliverables

• Automated CI/CD pipelines and Infrastructure as Code.
• Controlled environment promotion and deployment workflows.
• Monitoring dashboards and rollback procedures.
• Production-ready operational runbooks and handover documentation.

👉 Interested? Share your CV at rudrakshi.jain@zidea.tech