Sr Manager - GenAI/ LLM Ops

As a Senior Manager - AI/LLM Ops at a leading global management consulting firm based in Gurugram, you will be responsible for joining the Gen AI platform team and focusing on building and maintaining cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development. Your role will involve utilizing your expertise in platform engineering, cloud infrastructure, LLM Observability, and DevOps/MLOps/LLMOps to create scalable, reliable, and efficient systems. **Key Responsibilities:** - Build and support scalable, reliable Gen AI or LLM powered applications in production. - Develop and enable self-serve observability tools and dashboards for engineering teams. - Deliver and maintain platform or complex technology solutions with a strong technical background. - Develop, deploy, test, and maintain production-grade access to LLMs and related services. - Implement Modern Engineering, DevOps / GitOps, Infra as a Code practices. - Optimize LLM performance, usage, and cost. - Build CI/CD pipeline templates for AI SDLC. - Work with cloud platforms such as AWS, Azure, GCP and infrastructure as code tools like Terraform. - Utilize containerization and orchestration technologies like Kubernetes and Docker. - Collaborate with key LLM models APIs and LLM Frameworks. - Build secure data ingestion pipelines for structured/unstructured data. - Demonstrate proficiency in Python, Go, and Terraform. - Conduct LLM Testing and Evaluation. - Implement security measures related to LLM integration. **Qualifications Required:** - Bachelor's degree in computer science engineering or equivalent. - 12+ years of relevant experience in platform engineering and technology solutions. - Strong experience in Generative AI/ LLM development. - Proficiency in cloud platforms (AWS, Azure, GCP) and infrastructure as code. - Experience with containerization and orchestration technologies. - Proficiency in Python, Go, and Terraform. - Experience in LLM Testing and Evaluation is preferred. - Experience with security related to LLM integration is preferred.,