Home
>
Jobs in india
>
numberz.ai
>
QA Engineer, GenAI

QA Engineer, GenAI

numberz.ai

0 years

0 Lacs

india

Posted:2 weeks ago| Platform:

Apply

Skills Required

costing negotiation evaluation drift model data triage latency tooling python json github design checks retrieval controls sql docker connect writing encode security ethics

Work Mode

On-site

Job Type

Full Time

Job Description

Make our Should-Costing & Negotiation Copilot answers correct, safe, grounded —every time. You’ll define and own the quality bar for GenAI at Numberz.ai.

Outcomes (

Evaluation harness:

Safety

Grounding

Slice coverage:

Drift & staleness: Canary tests in place; MTTD < 24h for model/data drift; materials/FX freshness within SLA.

Observability

Cost/latency:

Skills:

Must-Haves

Python + Pytest; JSON Schema/strict parsers; CI (GitHub Actions).

LLM/RAG Testing

Grounding checks for RAG; retrieval coverage & freshness controls.

Safety Testing

Data Rraftsmanship: Curate goldens, create slices, measure IAA; basic SQL; Docker.

Competencies:

How You Work

Pragmatism over dogma

Systems thinking

Ownership & clarity:

Collaboration:

Security & ethics mindset
: Handle data and evals responsibly.

More Jobs at numberz.ai

QA Engineer, GenAI

india

Experience: Not specified

Salary: Not disclosed

AI Security and Reliability Engineer

india

Experience: Not specified

Salary: Not disclosed

Founding Principle Engineer

india

10.0 - 10.0 yrs

Salary: Not disclosed

React Developer (jr)

india

6.0 - 6.0 yrs

Salary: Not disclosed

Business Analyst (jr)

india

2.0 - 2.0 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.