Sr Manager - GenAI/ LLM Ops

As a Senior Manager - AI/LLM Ops at the leading global management consulting firm in Gurugram, you will play a crucial role in the Gen AI platform team. Your primary responsibility will be to build and maintain cloud-native platforms specifically designed for Generative AI and Large Language Model (LLM) development. Your expertise in platform engineering, cloud infrastructure, LLM Observability, and DevOps/MLOps/LLMOps will be instrumental in creating scalable, reliable, and efficient systems. Key Responsibilities: - Build and support scalable, reliable Gen AI or LLM powered applications in production. - Develop and enable self-serve observability tools and dashboards for engineering teams. - Deliver and maintain platform or complex technology solutions with a strong technical background, preferably in a global organization/enterprise. - Develop, deploy, test, and maintain production-grade access to LLMs and related services. - Implement Modern Engineering, DevOps/GitOps, Infra as Code practices, CI/CD, AI/ML pipelines, and automation tools. - Utilize cloud platforms (AWS, Azure, GCP) and infrastructure as code (Terraform, Terraform Cloud, Github Actions, ArgoCD) for effective deployment. - Work with containerization and orchestration technologies (Kubernetes, Docker) to optimize performance. - Collaborate with key LLM models APIs (e.g. AWS Bedrock, Azure Open AI/ OpenAI) and LLM Frameworks (e.g. LangChain, LlamaIndex) for integration. - Build secure data ingestion pipelines for structured/unstructured data including indexing, search, and advanced retrieval patterns. - Demonstrate proficiency in Python, Go, Terraform, and LLM Testing and Evaluation. Qualifications Required: - Bachelor's degree in computer science engineering or equivalent. - 12+ years of experience in Gen AI/LLM development and platform engineering. - Strong knowledge and experience in Generative AI/LLM based development. - Experience with CI/CD pipeline templates for AI SDLC, data ingestion pipelines, and automation tools. - Proficiency in cloud platforms (AWS, Azure, GCP), infrastructure as code, and security related to LLM integration. (Note: Additional details about the company were not present in the job description.),