Posted:3 hours ago|
Platform:
Hybrid
Full Time
Design and execute test strategies for Gen AI models including LLMs image generators and multimodal systems
Create and maintain test cases and prompt libraries to evaluate model output quality eg relevance coherence creativity factual accuracy
Test model behaviour across different scenarios languages and user intents eg hallucinations bias toxicity safety risks
Perform manual and automated testing of Gen AI APIs chatbots and content generation tools
Validate input output behaviour prompt testing response evaluation token level analysis
Collaborate with engineering teams to implement prompt evaluation frameworks log monitoring and output scoring systems
Track model performance metrics BLEU ROUGE perplexity toxicity score etc and suggest areas for improvement
Conduct fairness bias and safety testing to ensure compliance with ethical and regulatory guidelines
Assist in evaluating AB experiments and fine tuning model behaviours
Document issues clearly and contribute to root cause analysis with dev teams
Virtusa
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
hyderabad, chennai, bengaluru
15.0 - 25.0 Lacs P.A.
hyderabad, telangana, india
Salary: Not disclosed
chennai, tamil nadu
Salary: Not disclosed
Chennai, Tamil Nadu, India
Salary: Not disclosed
10.0 - 15.0 Lacs P.A.
navi mumbai, delhi / ncr, thiruvananthapuram
50.0 - 65.0 Lacs P.A.
hyderabad, chennai, bengaluru
15.0 - 25.0 Lacs P.A.
4.0 - 8.0 Lacs P.A.
10.0 - 20.0 Lacs P.A.
gurugram
Experience: Not specified
Salary: Not disclosed
