Job Description: Data Scientist
Job Title:
Data Scientist
Locations:
Bangalore / Pune
Experience:
5-12 Years
Employment Type:
Full-Time
Job Summary
We are looking for an experienced Data Scientist with strong expertise in classical Machine Learning, AI/ML evaluation, and Large Language Models (LLMs). The ideal candidate should be skilled in problem framing, defining evaluation metrics, conducting experiments, and developing AI/ML solutions, with foundational knowledge of prompt engineering and Retrieval-Augmented Generation (RAG).
Key Responsibilities
-
Translate business requirements into data science problems and define measurable success criteria.
-
Develop, train, evaluate, and optimize classical machine learning models.
-
Define and track AI/ML performance metrics, including accuracy, precision, recall, F1-score, and business-specific KPIs.
-
Contribute to LLM development and evaluation, including response quality, relevance, groundedness, and hallucination assessment.
-
Apply prompt engineering techniques and understand basic RAG architectures and workflows.
-
Design and execute experiments, including hypothesis testing, A/B testing, and model comparisons.
-
Perform feature engineering, data preprocessing, model validation, and error analysis.
-
Document model assumptions, limitations, evaluation results, risks, and intended use through model cards.
-
Collaborate with data engineers, ML engineers, product teams, and business stakeholders to deliver scalable AI solutions.
Required Skills
-
Strong understanding of problem framing and analytical thinking.
-
Hands-on experience with classical ML algorithms and model development.
-
Knowledge of AI/ML evaluation metrics and model validation techniques.
-
Experience with LLM development and evaluation.
-
Basic understanding of prompt engineering and RAG.
-
Experience in experiment design, hypothesis testing, and statistical analysis.
-
Familiarity with model documentation, model cards, and responsible AI principles.
-
Strong Python and SQL programming skills.
-
Experience with libraries such as Pandas, NumPy, Scikit-learn, and relevant ML/LLM frameworks.
Preferred Qualifications
-
Experience evaluating generative AI applications and LLM outputs.
-
Familiarity with frameworks such as LangChain or LlamaIndex.
-
Exposure to ML experiment tracking and model lifecycle tools.
-
Understanding of bias, explainability, reproducibility, and responsible AI practices.