5 - 8 years

10 - 20 Lacs

Posted:4 hours ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description


We are seeking a Senior Data Scientist with deep expertise in Machine Learning, Generative AI (Gen AI), Large Language Models (LLMs), and experimental design to join our growing AI team. This role is ideal for someone passionate about evaluating cutting-edge ML/Gen AI systems, designing robust A/B tests, and translating data into actionable insights that drive product and business strategy.

Job Title: Senior Data Scientist Machine Learning & Gen AI Evaluation

Location: Hyderabad | Experience Level: 5+ Years

Employment Type: Full-Time

Responsibilities:

  • Design and implement evaluation pipelines for LLMs and other Gen AI systems, including human and automated benchmarking.
  • Lead the design, execution, and analysis of A/B tests and other controlled experiments to evaluate product and ML feature performance.
  • Develop, validate, and optimize ML models across various domains (e.g., NLP, recommendation, personalization).
  • Analyze system behavior using statistical methods to improve accuracy, fairness, robustness, and user experience.
  • Work cross-functionally with Product, Engineering, and Research to embed data-driven insights into the development cycle.
  • Build tools and dashboards to monitor model performance and key business metrics over time.

Required Qualifications:

  • 5+ years of hands-on experience in Data Science or Applied Machine Learning roles.
  • Proven experience working with LLMs and Generative AI technologies (e.g., OpenAI, Hugging Face, fine-tuning, prompt engineering).
  • Strong background in experimental design, A/B testing, and causal inference.
  • Proficient in Python and common data science libraries (e.g., NumPy, Pandas, Scikit-learn, PyTorch/TensorFlow).
  • Experience with cloud platforms (AWS, GCP, or Azure) and data infrastructure (e.g., SQL, Spark).
  • Strong communication skills with the ability to present complex findings to technical and non-technical stakeholders.

Preferred Qualifications:

  • Advanced degree (Graduation/Post-Graduation) in Computer Science, Statistics, Machine Learning, or a related field.
  • Experience working on GenAI evaluation at scale, including RLHF or other human feedback techniques.
  • Familiarity with privacy, fairness, and ethical considerations in ML/GenAI systems.

Mock Interview

Practice Video Interview with JobPe AI

Start Machine Learning Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

RecommendedJobs for You

kolkata, mumbai, new delhi, hyderabad, pune, chennai, bengaluru