Gen AI Testing

Space Inventive

7 years

0 Lacs

hyderabad telangana india

Posted:5 days ago| Platform:

Apply

Skills Required

ai testing software ml agile model analysis api openai azure mlflow test automation selenium postman evaluation metrics jira testrail confluence tuning data drift design inference integration tooling

Work Mode

On-site

Job Type

Full Time

Job Description

Required Experience:

5–7 years
in software testing, with
at least 3 years
focused on AI/ML applications
Proven experience in
hands-on testing and validation
of GenAI or ML-based products
2+ years
of agile testing experience in cross-functional, fast-paced environments
Hands-on experience testing
LLM-based applications
(e.g., ChatGPT, Claude, Gemini)
Strong proficiency in
prompt engineering
, model behavior analysis, and edge case identification
Experience with
API testing
for AI services (OpenAI, Anthropic, Azure AI, Hugging Face)
Familiarity with
AI observability tools
and testing frameworks (MLflow, Weights & Biases, LangSmith)

Technical Skills:

Advanced use of
test automation tools
(Selenium, Postman, Pytest, Robot Framework)
Deep understanding of
NLP concepts
and evaluation metrics (BLEU, ROUGE, perplexity, METEOR)
Experience with
bias detection
, fairness testing, and adversarial testing in AI systems
Knowledge of
model versioning
, A/B testing, and performance benchmarking
Proficiency in
Agile testing tools
(Jira, TestRail, Confluence) and
CI/CD pipelines
Working knowledge of
transformer architectures
, fine-tuning, and model interpretability
Exposure to
data drift
, concept drift, and model degradation monitoring

Key Responsibilities:

Design and execute hands-on test cases
for prompt accuracy, response quality, and safety validation
Validate model outputs for
hallucinations
,
bias
,
toxicity
, and
alignment issues
Perform
load and stress testing
on AI inference endpoints and pipelines
Test integration between GenAI models and
enterprise application workflows
Collaborate with product owners to define
acceptance criteria
and
quality gates
Participate in sprint ceremonies and contribute to
release planning
Document model behavior patterns, failure modes, and
test coverage gaps
Mentor junior testers and contribute to
QA best practices
for AI systems
Actively contribute to
test automation
,
tooling improvements
, and
test data generation

More Jobs at Space Inventive

Project Manager/Technical Project Manager

Hyderabad

10 - 18 yrs

INR 20 - 27 Lacs

UI Developer/Senior UI Developer

Hyderabad

3 - 6 yrs

INR 12 - 18 Lacs

Senior PHP Developer

Hyderabad

4.0 - 8.0 yrs

INR 15 - 20 Lacs

Machine Learning Engineer

Greater Hyderabad Area

3.0 - 3.0 yrs

Salary: Not disclosed

Senior Machine Learning Engineer

Hyderabad, Telangana, India

3.0 - 3.0 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.