2 - 5 years

2 - 6 Lacs

Posted:2 months ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

As part of our fast-moving team, youll help shape the quality and reliability of how our AI interacts with consumers. Role Overview Were looking for a highly independent AI QA Engineer who thrives at the intersection of traditional QA and cutting-edge AI evaluation. This role spans frontend automation, backend API testing, and the challenge of evaluating AI output for quality, correctness, and speed. Responsibilities Design and implement automated UI regression tests Write and maintain robust API test suites to validate backend functionality with each release Create and run AI evaluation tests to assess: Quality and correctness of chatbot responses compared to ground truth and other products TTFT, end-to-end-latency, and other timing performance Build internal tools and datasets for testing and benchmarking Collaborate closely with product, engineering, and AI teams to ensure end-to-end quality of AI product Requirements Strong experience with frontend testing tools (e.g., Playwright, Cypress) Proficient in backend/API testing (e.g., Postman, pytest, REST/GraphQL) Familiarity with evaluating LLM/AI-generated content Comfortable designing and analyzing test datasets for AI performance and functionality Strong scripting skills (e.g., Python) Highly autonomous with excellent problem-solving skills

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You

noida, uttar pradesh

Bengaluru, Karnataka, India

Coimbatore, Tamil Nadu, India