Momento Cybertech Solutions logo

AI Test Engineer

Momento Cybertech Solutions

5 - 8 years

Hyderabad Pune Chennai

Posted:7 hours ago

Job Description

Role & responsibilities

Hiring: AI Testing Engineer | GenAI | RAG | Agents | Python

Experience:

Notice Period:

We are looking for experienced AI Testing / GenAI Assurance Engineers with hands-on experience in evaluating LLM, RAG-based applications and AI Agents.

Key Skills Required:

  • Strong Python programming skills.
  • Hands-on experience with Ragas and/or DeepEval.
  • Experience in LLM Evaluation and LLM-as-a-Judge.
  • RAG application testing and evaluation.
  • AI Agent / Agentic AI evaluation.
  • Golden Dataset and Synthetic Dataset creation.
  • AI Observability and tracing using OpenTelemetry (OTEL).
  • Exposure to LangSmith, Langfuse, Arize, Galileo or Evidently.
  • Responsible AI validation and AI quality assurance.
  • CI/CD integration of AI evaluation frameworks.

Mandatory Screening Criteria:

  • 4+ years of relevant AI Assurance Testing experience.
  • Python proficiency above 6/10.
  • Hands-on implementation of Ragas or DeepEval.
  • Experience using LLM Judges.
  • Minimum 6 months of RAG evaluation experience with at least one project.

Skills Required

Software testing Evaluation Artificial Intelligence

Learn the skills this job asks for

See your skill gap for QA / Test Engineer →

Free courses, interview questions and practice for each skill.

Work Mode

Work from Office

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start Artificial Intelligence Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Momento Cybertech Solutions logo
Momento Cybertech Solutions

RecommendedJobs for You

Momento Cybertech Solutions logo

AI Test Engineer

Momento Cybertech Solutions

Hyderabad, Pune, Chennai

AXA Global Business Services logo

AI Test Engineer

AXA Global Business Services

Pune, Bengaluru

I

AI Test Engineer

Inceptigon Information Technology Services

Bengaluru

WSA logo

Hyderabad

WSA APAC logo

Hyderabad

Momento Cybertech Solutions logo

AI Test Engineer

Momento Cybertech Solutions

Hyderabad, Pune, Chennai

AXA Global Business Services logo

AI Test Engineer

AXA Global Business Services

Pune, Bengaluru

I

AI Test Engineer

Inceptigon Information Technology Services

Bengaluru

WSA logo

Hyderabad

WSA APAC logo

Hyderabad