Jobs
Interviews
U

LLM Test Engineer / AI Evaluation Engineer

Upswing Cognitive Hospitality Solutions

1 Lacs

Pune

Posted:23 hours ago

Job Description

Responsibilities

  • Test AI conversations for accuracy, hallucinations and correct source citation
  • Check role-based answers, multilingual replies and out-of-scope handling
  • Run safety tests such as prompt-injection attempts
  • Compare new prompt and model versions against the previous baseline
  • Do manual, smoke and regression testing of the dashboard, chat widget and booking flows
  • Write test cases and log clear, reproducible bugs on GitHub

Must-have Skills

  • Manual testing: test cases, positive/negative and boundary testing, regression, bug life cycle
  • LLM testing: hands-on with ChatGPT, Claude or Gemini; understands hallucinations and prompt behaviour
  • Prompt engineering basics
  • Strong attention to detail and written English
  • Clear bug reporting

Pay: From ₹10,000.00 per month

Work Location: In person

Skills Required

Regression Testing Test Cases GitHub Manual Testing Attention to Detail BUG Reporting Git Problem solving Generative AI and LLMs Business English

Learn the skills this job asks for

See your skill gap for QA / Test Engineer →

Free courses, interview questions and practice for each skill.

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
U
Upswing Cognitive Hospitality Solutions

RecommendedJobs for You

U

LLM Test Engineer / AI Evaluation Engineer

Upswing Cognitive Hospitality Solutions

Pune

U

LLM Test Engineer / AI Evaluation Engineer

Upswing Cognitive Hospitality Solutions

Pune