LLM Ops Developer

Role Purpose The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters Machine Learning & Deep Learning – Strong understanding of LLM architectures, transformers, and fine-tuning techniques. MLOps & DevOps – Experience with CI/CD pipelines, model deployment, and monitoring. Vector Databases – Knowledge of storing and retrieving embeddings efficiently. Prompt Engineering – Ability to craft effective prompts for optimal model responses. Retrieval-Augmented Generation (RAG) – Implementing techniques to enhance LLM outputs with external knowledge. Cloud Platforms – Familiarity with AWS, Azure, or GCP for scalable deployments. Containerization & Orchestration – Using Docker and Kubernetes for model deployment. Observability & Monitoring – Tracking model performance, latency, and drift. Security & Ethics – Ensuring responsible AI practices and data privacy. Programming Skills – Strong proficiency in Python, SQL, and API development. Knowledge of Open-Source LLMs – Familiarity with models like LLaMA, Falcon, and Mistral. Fine-Tuning & Optimization – Experience with LoRA, quantization, and efficient training techniques. LLM Frameworks – Hands-on experience with Hugging Face, LangChain, or OpenAI APIs. Data Engineering – Understanding of ETL pipelines and data preprocessing. Microservices Architecture – Ability to design scalable AI-powered applications. Explainability & Interpretability – Techniques for understanding and debugging LLM outputs. Graph Databases – Knowledge of Neo4j or similar technologies for complex data relationships. Collaboration & Communication – Ability to work with cross-functional teams and explain technical concepts clearly. Deliver No. Performance Parameter Measure 1. Continuous Integration, Deployment & Monitoring of Software 100% error free on boarding & implementation, throughput %, Adherence to the schedule/ release plan 2. Quality & CSAT On-Time Delivery, Manage software, Troubleshoot queries, Customer experience, completion of assigned certifications for skill upgradation 3. MIS & Reporting 100% on time MIS & report generation Mandatory Skills: LLM Ops. Experience3-5 Years.