Principal LLM Engineer

Agentic AI architecture

Key Responsibilities

• Architect and deploy multi-agent AI frameworks using Azure OpenAI, Semantic Kernel, and Azure AI Foundry.
• Design RAG pipelines integrating Azure Cognitive Search, Data Lake, and vector databases for contextual reasoning.
• Fine-tune and optimize LLMs for domain-specific use cases and enterprise copilots.
• Develop adaptive memory and context management systems for agent collaboration and reasoning continuity.
• Build connectors and plugins integrating Copilot experiences with Microsoft 365, Dynamics, and Power Platform.
• Implement orchestration pipelines for hybrid reasoning and multi-agent task routing.
• Ensure compliance, governance, and observability through Responsible AI and Azure security standards (RBAC, Managed Identity).
• Evaluate model performance, grounding, and bias mitigation through human-in-the-loop and telemetry-driven feedback loops.

Required Qualifications

• Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, or related technical field.

• 7+ years

  of experience in AI systems engineering, cloud architecture, or software development.
• Proven hands-on experience with

  Azure OpenAI Service, Semantic Kernel, CoPilot Studio, and Azure AI Foundry

  .
• Expertise in

  LLM orchestration, fine-tuning, RAG systems

  , and

  multi-agent architectures

  .
• Proficiency in

  Python, C#, PyTorch

  , and

  RESTful API

  development for Azure Functions and microservices.
• Strong understanding of

  Azure Cognitive Search, Data Factory, Event Grid

  , and data governance principles.

Preferred Qualifications

• Experience developing

  Copilot extensions or plugins

  for Microsoft 365 or Dynamics 365.
• Familiarity with

  LangChain, AutoGen

  , or similar orchestration frameworks.
• Background in

  knowledge management, ontologies, and enterprise copilots

  .
• Microsoft Certified:

  Azure Solutions Architect Expert

  or

  Azure AI Engineer Associate

  .
• Understanding of

  MLOps

  , CI/CD, and

  Azure DevOps pipelines

  for AI deployment.

Core Competencies

• Deep expertise in

  Azure’s AI and agentic ecosystem

  .
• Strong architectural and systems design thinking for large-scale AI.
• Ability to bridge

  LLM reasoning with enterprise data and tools

  .
• Commitment to

  Responsible AI, security, and cost-optimized model operations

  .
• Proven skill in

  translating business processes into intelligent autonomous workflows

  .