Jobs
Interviews
Virtusa logo

Senior Automation Engineer-GenAI

3 years

0 Lacs

andhra pradesh india

Posted:4 days ago| Platform: Linkedin logo

Apply

Skills Required

automation design test ai content model api integration ui ux ml data preprocessing evaluation metrics regression testing training tuning selenium postman deployment monitoring compliance engineering software junit testng tracking python scripting rest learning vision

Work Mode

On-site

Job Type

Full Time

Job Description

Key Responsibilities

Design, develop, and execute manual and automated test plans for Gen AI applications (e.g., LLM-based chatbots, content generators, recommendation systems).Test end-to-end functionality including model input/output validation, API integration, UI/UX, and performance benchmarks.Identify, document, and track bugs and anomalies, especially in AI-generated outputs (hallucinations, bias, toxicity, etc.).Collaborate with ML engineers to validate model quality, data preprocessing pipelines, and evaluation metrics (e.g., BLEU, ROUGE, F1, precision/recall).Conduct model regression testing when new training data or fine-tuning is introduced.Develop and maintain automated test frameworks for APIs and web interfaces using tools like Selenium, Postman, PyTest, etc.Assist in A/B testing, model deployment validation, and monitoring performance in production.Ensure compliance with responsible AI standards, including fairness, privacy, and explainability.

Required Qualifications

Bachelor's degree in Computer Science, Engineering, or a related field.3+ years of QA experience in software testing, ideally with exposure to AI/ML projects.Strong knowledge of testing frameworks (e.g., PyTest, JUnit, TestNG) and bug tracking tools (e.g., Jira).Proficiency in Python or other scripting languages for test automation.Familiarity with REST APIs, CI/CD pipelines, and version control (Git).Understanding of machine learning concepts and Gen AI model behaviors (LLMs, transformers, etc.).

Preferred Qualifications

Experience testing LLM applications like ChatGPT, Claude, Gemini, or custom-built models.Knowledge of prompt engineering, vector databases (e.g., Pinecone, FAISS), or RAG pipelines.Experience with AI evaluation tools (e.g., LangChain, Weights & Biases, Trulens).Background in NLP, computer vision, or multimodal AI testing is a plus.

More Jobs at Virtusa

Servicenow QA

Bengaluru, Karnataka

3 - 3 yrs
|

Salary: Not disclosed

React T3

Bengaluru, Karnataka

Experience: Not specified

|

Salary: Not disclosed

Java-Pankaj

Bengaluru, Karnataka

Experience: Not specified

|

Salary: Not disclosed

C ++

Bengaluru, Karnataka

Experience: Not specified

|

Salary: Not disclosed

Java Architect (ATC)

Bengaluru, Karnataka

Experience: Not specified

|

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store
coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Virtusa logo
Virtusa

Information Technology and Services

Southborough

RecommendedJobs for You

Virtusa logo

Senior Automation Engineer-GenAI

Virtusa

andhra pradesh, india

Virtusa logo

Senior Automation Engineer-GenAI

Virtusa

andhra pradesh, india