Lead AI Developer and DevOps

Role Overview: As a AI Model Development and Deployment Lead, your main responsibility will be to collaborate with ML Engineers and DevOps Engineers in formulating AI designs that can be built, tested, and deployed through the Route to Live and into Production using continuous integration/deployment processes. Key Responsibilities: - Model fine-tuning using open-source libraries like DeepSpeed, Hugging Face Transformers, JAX, PyTorch, and TensorFlow to improve model performance - Model deployment and maintenance, which involves deploying and managing Large Language Models (LLMs) on cloud platforms - Data management and pipeline operations, including curating and preparing training data, transforming, aggregating, and de-duplicating data, and building vector databases for retrieving contextually relevant information - Monitoring and evaluating LLM performance, identifying errors, and optimizing models with monitoring metrics - Infrastructure and DevOps tasks such as continuous integration and delivery (CI/CD) automation, managing infrastructure for distributed model training using tools like SageMaker, Ray, and Kubernetes, and deploying ML models using containerization technologies like Docker - Utilizing programming languages and frameworks like Python, LLM pipelines, cloud platforms like AWS, Azure, or GCP, and LLM-specific technologies such as vector databases, prompt engineering, and fine-tuning techniques Qualifications Required: - Proficiency in programming languages like Python for ML model development - Experience with open-source libraries like DeepSpeed, Hugging Face Transformers, JAX, PyTorch, and TensorFlow - Knowledge of containerization technologies like Docker and Kubernetes - Familiarity with cloud platforms like AWS, Azure, or GCP and their services for scalable and efficient model deployment - Experience with distributed training infrastructure and LLM-specific technologies like vector databases and fine-tuning techniques Additional Details: The company location for this role is at DGS India in Pune, Baner. This is a full-time permanent position under the brand Merkle.,