Machine Learning Engineer – RAG & Fine-Tuning

Join ABC Fitness, the leading technology provider for the fitness industry!

Job Description

This role requires working from our local Hyderabad office 2-3x a week.
Location: Hyderabad, Telangana, India

ABOUT THE TEAM

The AI Platform Engineering team at ABC builds scalable, high-performance AI systems that power next-generation fitness technology. We specialize in retrieval-augmented generation (RAG) architectures and fine-tuning methodologies to deliver context-aware, cost-efficient AI solutions. As our Machine Learning Engineer, you will be responsible for all retrieval and intelligence behind the LLM, delivering performant, low-cost, high-context AI features.

At ABC, we love entrepreneurs because we are entrepreneurs. We roll our sleeves up, we act fast, and we learn together.

WHAT YOU’LL DO

• Handle embeddings and chunking strategies to optimize document and data retrieval for GenAI-powered features.
• Manage vector stores and retrieval workflows using leading vector databases (Pinecone, FAISS, Weaviate, Azure AI Search) to ensure efficient, scalable access to unstructured and structured data.
• Fine-tune small and large language models using frameworks such as HuggingFace and OpenAI APIs, tailoring models to domain-specific requirements and improving performance on targeted tasks.
• Optimize cost and reduce latency by implementing best practices for token management, model evaluation, and cloud resource utilization.
• Collaborate with engineering, product, and data teams to integrate RAG pipelines into production systems, ensuring reliability, scalability, and security.
• Stay up-to-date with the latest advancements in retrieval-augmented generation, vector search, and LLM fine-tuning, applying new techniques to improve system performance and user experience.

WHAT YOU’LL NEED

• 4–7 years of experience in machine learning or AI engineering, with a proven track record in RAG, vector search, and LLM fine-tuning.
• Deep expertise with vector databases such as Pinecone, FAISS, Weaviate, or Azure AI Search, including experience designing retrieval workflows and managing embeddings.
• Familiarity with HuggingFace and OpenAI fine-tuning APIs, and strong understanding of chunking strategies for optimizing retrieval.
• Proficiency in Python and experience with ML frameworks (PyTorch, TensorFlow) and cloud platforms (AWS, Azure).
• Understanding of token management, evaluation tuning, and cost optimization for large-scale AI deployments.
• Strong problem-solving skills, a collaborative mindset, and the ability to communicate complex technical concepts to both technical and non-technical stakeholders.

AND IT’S GREAT TO HAVE

• Experience with NLP, NLU, and NLG techniques for conversational AI or information retrieval.
• Exposure to ML Ops tools for model monitoring, evaluation, and deployment (ML flow, Weights & Biases).
• Experience with model compression, quantization, or other efficiency techniques.
• Certifications in AWS Machine Learning Specialty or Microsoft AI Engineer.

WHAT’S IN IT FOR YOU:

• Purpose led company with a Values focused culture – Best Life, One Team, Growth Mindset
• Time Off – competitive PTO plans with 15 Earned accrued leave, 12 days Sick leave, and 12 days Casual leave per year
• 11 Holidays plus 4 Days of Disconnect – once a quarter, we take a collective breather and enjoy a day off together around the globe. #oneteam
• Group Mediclaim insurance coverage of INR 500,000 for employee + spouse, 2 kids, and parents or parent-in-laws, and including EAP counseling
• Life Insurance and Personal Accident Insurance
• Best Life Perk – we are committed to meeting you wherever you are in your fitness journey with a quarterly reimbursement
• Premium Calm App – enjoy tranquility with a Calm App subscription for you and up to 4 dependents over the age of 16
• Support for working women with financial aid towards crèche facility, ensuring a safe and nurturing environment for their little ones while they focus on their careers.

#LI-HYBRID

If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!