Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Jobs

Interviews

Home
>
Jobs in Bengaluru
>
Talent Worx
>
Gen AI Tester

Gen AI Tester

Talent Worx

3 years

5 - 12 Lacs

Bengaluru Karnataka India

Posted:3 days ago| Platform:

Apply

Skills Required

ai reliability testing compliance design test tuning evaluation jira ml management scripting python engineering model retrieval

Work Mode

On-site

Job Type

Full Time

Job Description

Job Title: Generative AI Tester
Experience: 3+ years / 6+ yearsJob Description:We are seeking a detail-oriented Generative AI Tester to validate the quality, reliability, and ethical outputs of AI systems powered by large language models (LLMs). This role focuses on testing prompt responses, evaluating edge cases, and ensuring AI outputs align with business and compliance standards.Key Responsibilities:

Design and execute test cases for Gen AI features and conversational workflows
Validate outputs of LLMs for accuracy, relevance, coherence, and safety
Conduct prompt testing, fine-tuning evaluation, and edge-case scenario validation
Collaborate with AI engineers, product managers, and QA teams to improve test coverage and feedback loops
Document defects, issues, and improvement areas using tools like JIRA or similar
Evaluate AI systems against ethical and fairness benchmarks

Requirements:

2+ years of experience in QA/testing, with exposure to AI/ML or NLP systems
Familiarity with LLMs (e.g., GPT, Claude, or open-source alternatives)
Strong analytical and critical thinking skills for non-deterministic system testing
Experience with test management tools and basic scripting (Python preferred)
Good understanding of prompt engineering and model evaluation principles

Preferred Qualifications:

Experience in testing conversational AI, chatbots, or virtual assistants
Understanding of responsible AI practices, including bias and hallucination detection
Exposure to RAG (Retrieval-Augmented Generation) pipelines and vector databases

More Jobs at Talent Worx

Python Data Engineer

Hyderabad, Telangana, India

5 - 8 yrs

Salary: Not disclosed

PLSQL Developer

Hyderabad, Telangana, India

5 - 8 yrs

Salary: Not disclosed

Site Leader - Talent Acquisition Delivery

Jaipur, Rajasthan, India

5 - 8 yrs

Salary: Not disclosed

Python Developer

Hyderabad, Telangana, India

5 - 8 yrs

Salary: Not disclosed

SAP ABAP Developer - Sr. Consultant

Greater Kolkata Area

2 - 5 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

Talent Worx

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Upskill and Grow with AI

Gen AI Tester