Devsecops Engineer

Job Title: AgentOps/DevSecOps Engineer

Exp: 6 +

Work Mode: Hybrid

KPI Partners is seeking an experienced AgentOps / DevSecOps Engineer to join our dynamic team. The successful candidate will play a crucial role in building, maintaining, and optimizing our data and machine learning operations using Azure Databricks and Genie Agents. This position requires proficiency in implementing continuous integration and continuous deployment (CI/CD) practices utilizing Azure DevOps or GitHub Actions, along with expertise in MLflow for machine learning model management and observability. The ideal candidate will also have experience with Unity Catalog and Unity Gateway, ensuring robust data governance and security measures in alignment with Azure's security protocols.

Key Responsibilities:

• Design, implement, and manage CI/CD pipelines to automate deployment processes for data and machine learning applications.
• Collaborate with data engineers, data scientists, and other stakeholders to enhance the operational efficiency of machine learning models.
• Utilize Azure Databricks and Genie Agents for scalable data processing and analytics.
• Implement and manage MLflow for tracking experiments, managing models, and facilitating reproducibility in machine learning workflows.
• Ensure observability of the data pipeline and model performance through monitoring and logging strategies.
• Manage access control and governance practices using Unity Catalog and Unity Gateway.
• Implement best practices for Azure security, ensuring the integrity and confidentiality of data and systems.

Skills Required:

• Proficiency with Azure Databricks and Genie Agents.
• Experience with CI/CD tools, specifically Azure DevOps or GitHub Actions.
• Familiarity with MLflow for machine learning operations and model lifecycle management.
• Strong knowledge of observability techniques and monitoring tools.
• Experience with Unity Catalog and Unity Gateway for data governance.
• Understanding of Azure security principles and practices.
• Strong problem-solving skills and ability to work collaboratively in a team environment.
• Excellent communication skills to convey complex technical concepts effectively.

Tools Required:

• Azure Databricks
• Genie Agents
• Azure DevOps or GitHub Actions
• MLflow
• Monitoring and observability tools
• Unity Catalog and Unity Gateway
• Azure Security tools

Mandatory Skills

• Azure Devops
• CI/CD
• MLflow 3
• Unity Catalog
• Azure Security