Agentic QA Engineer

Bespoke Technologies

1 - 5 years

8 - 12 Lacs

bengaluru

Posted:15 hours ago| Platform:

Apply

Skills Required

deepeval quality assurance engineering java manual testing model performance tuning python

Work Mode

Work from Office

Job Type

Full Time

Job Description

About the Role

Key Responsibilities

Test and validate
AI agents
to ensure they perform actions accurately and as designed.
Develop and execute
test cases
for different conversational and task-based AI workflows.
Analyze test results, identify bugs or performance issues, and collaborate with the engineering team for fixes.
Document testing procedures, outcomes, and recommendations for improvement.
Ensure that AI agents handle prompts, contexts, and actions correctly.
Contribute to the creation of
automated QA processes
for AI systems.

Required Skills & Qualifications

1 - 5 years of experience in QA, software testing, or AI testing roles.
Good understanding of
Generative AI
,
LLM agents
, or
autonomous AI workflows
. Understanding of DeepEval and other AI testing frameworks.
Experience with
manual testing
and familiarity with
automation tools
.
Strong problem-solving, analytical, and communication skills.
Ability to work collaboratively with developers, prompt engineers, and data scientists.

Good to Have

Exposure to
LLM frameworks (LangChain, CrewAI, AutoGen, etc.)
.
Basic programming or scripting knowledge (Java or Python preferred).
Understanding of
AI evaluation metrics
and
model performance tuning
.
Role & responsibilities

More Jobs at Bespoke Technologies

Python Developer Lead

Bengaluru

3.0 - 8.0 yrs

INR 15 - 25 Lacs

Java Lead

Pune, Bengaluru, Delhi / NCR

3.0 - 8.0 yrs

INR 15 - 25 Lacs

Mern Stack Developer

pune

2.0 - 6.0 yrs

INR 8 - 15 Lacs

Full Stack Developer (Java + JavaScript)

bengaluru

2.0 - 5.0 yrs

INR 12 - 15 Lacs

Prompt Engineer

bengaluru

1.0 - 4.0 yrs

INR 10 - 14 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Java Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.