Gen AI Testing Professional

Virtusa

2 - 5 years

12 - 16 Lacs

chennai

Posted:1 day ago| Platform:

Apply

Skills Required

gen ai log monitoring apis compliance design ai automated testing root cause analysis ai models

Work Mode

Work from Office

Job Type

Full Time

Job Description

Design and execute test strategies for Gen AI models including LLMs image generators and multimodal systemsCreate and maintain test cases and prompt libraries to evaluate model output quality eg relevance coherence creativity factual accuracy
Test model behaviour across different scenarios languages and user intents eg hallucinations bias toxicity safety risksPerform manual and automated testing of Gen AI APIs chatbots and content generation toolsValidate input output behaviour prompt testing response evaluation token level analysis
Collaborate with engineering teams to implement prompt evaluation frameworks log monitoring and output scoring systemsTrack model performance metrics BLEU ROUGE perplexity toxicity score etc and suggest areas for improvementConduct fairness bias and safety testing to ensure compliance with ethical and regulatory guidelinesAssist in evaluating AB experiments and fine tuning model behavioursDocument issues clearly and contribute to root cause analysis with dev teams

More Jobs at Virtusa

Servicenow QA

Bengaluru, Karnataka

3 - 3 yrs

Salary: Not disclosed

React T3

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

Java-Pankaj

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

C ++

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

Java Architect (ATC)

Bengaluru, Karnataka

Experience: Not specified

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.