Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Home
>
Jobs in pune
>
Hexaware Technologies
>
AI QA Testers

AI QA Testers

Hexaware Technologies

6 - 11 years

6 - 16 Lacs

pune chennai coimbatore

Posted:3 weeks ago| Platform:

Apply

Skills Required

llm prompt engineering pytest ai models ai testing python

Work Mode

Work from Office

Job Type

Full Time

Job Description

Hexaware hiring AI QA Testers

AI QA Testers

Role & responsibilities

Perform
QA testing for AI/LLM-based applications
ensuring accuracy, reliability, and compliance.
Evaluate
LLM responses
using tools like
Ragas
,
LangSmith
, and other benchmarking frameworks.
Design and optimize
prompts
for better model performance.
Contribute to
LLM response optimization techniques
(token usage, latency improvements).
Conduct
performance testing
for LLM responses, including metrics like
Inter Token Latency
.
Collaborate with developers and data scientists to improve AI model quality.
Write and execute
Python scripts
and basic
SQL queries
for validation and automation.

Preferred candidate profile

Strong understanding of
AI technologies
and
LLM architectures
.
Hands-on experience with
Ragas
,
LangSmith
, or similar evaluation tools.
Expertise in
Prompt Engineering
.
Programming skills in
Python
and basic
SQL
.
Knowledge of
performance testing
for AI models.
Familiarity with
token optimization
and
response tuning techniques
.

Nice to Have

Exposure to
OpenAI
,
Azure OpenAI
,
Hugging Face
, or similar platforms.
Experience in
AI model deployment and monitoring
.

MichaelJacksonA@hexaware.com

Mandatory Details :

Overall Experience:
Relevant Experience (AI QA / LLM Testing):
Current CTC:
Expected CTC:
Notice Period:
Current Location:

More Jobs at Hexaware Technologies

Openings For Quality Analyst(Malayalam / Kannada) _ Chennai

Chennai

3 - 7 yrs

INR 3 - 4 Lacs

Process Analyst ESG

Navi Mumbai

3 - 6 yrs

INR 5 - 8 Lacs

Microsoft Full stack Developer

Chennai, Pune, Bengaluru

7 - 12 yrs

INR 10 - 20 Lacs

Microsoft Full Stack Engineer

Pune

6 - 11 yrs

INR 10 - 20 Lacs

Openings For Assistant Manager/Team Lead_International Voice Process

Chennai

4 - 9 yrs

INR 1 - 5 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.