Jobs
Interviews

1 Evaluating Ml Jobs

Setup a job Alert
JobPe aggregates results for easy application access, but you actually apply on the job portal directly.

5.0 - 8.0 years

10 - 20 Lacs

hyderabad

Work from Office

We are seeking a Senior Data Scientist with deep expertise in Machine Learning, Generative AI (Gen AI), Large Language Models (LLMs), and experimental design to join our growing AI team. This role is ideal for someone passionate about evaluating cutting-edge ML/Gen AI systems, designing robust A/B tests, and translating data into actionable insights that drive product and business strategy. Job Title: Senior Data Scientist Machine Learning & Gen AI Evaluation Location: Hyderabad | Experience Level: 5+ Years Employment Type: Full-Time Responsibilities: Design and implement evaluation pipelines for LLMs and other Gen AI systems, including human and automated benchmarking. Lead the design, execution, and analysis of A/B tests and other controlled experiments to evaluate product and ML feature performance. Develop, validate, and optimize ML models across various domains (e.g., NLP, recommendation, personalization). Analyze system behavior using statistical methods to improve accuracy, fairness, robustness, and user experience. Work cross-functionally with Product, Engineering, and Research to embed data-driven insights into the development cycle. Build tools and dashboards to monitor model performance and key business metrics over time. Required Qualifications: 5+ years of hands-on experience in Data Science or Applied Machine Learning roles. Proven experience working with LLMs and Generative AI technologies (e.g., OpenAI, Hugging Face, fine-tuning, prompt engineering). Strong background in experimental design, A/B testing, and causal inference. Proficient in Python and common data science libraries (e.g., NumPy, Pandas, Scikit-learn, PyTorch/TensorFlow). Experience with cloud platforms (AWS, GCP, or Azure) and data infrastructure (e.g., SQL, Spark). Strong communication skills with the ability to present complex findings to technical and non-technical stakeholders. Preferred Qualifications: Advanced degree (Graduation/Post-Graduation) in Computer Science, Statistics, Machine Learning, or a related field. Experience working on GenAI evaluation at scale, including RLHF or other human feedback techniques. Familiarity with privacy, fairness, and ethical considerations in ML/GenAI systems.

Posted 9 hours ago

Apply
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Featured Companies