Get alerts for new jobs matching your selected skills, preferred locations, and experience range.
4.0 - 7.0 years
18 - 20 Lacs
Hyderabad, Chennai
Work from Office
Expert in HP NonStop (COBOL 85/2002, Guardian, OSS), Enscribe, SQL/MP, Pathway, TMF. Skilled in AI-driven legacy code analysis, business rule extraction, and validation of AI logic. Mail:kowsalya.k@srsinfoway.com
Posted 1 week ago
4 - 9 years
7 - 17 Lacs
Mumbai
Work from Office
About the Role We're seeking a skilled Python QA Analyst to join our team focused on AI and agentic systems. In this role, you'll ensure the quality and reliability of our AI products while occasionally supporting agentic development during periods of lower QA workload. Key Responsibilities Design, implement and maintain comprehensive test suites for AI and agentic systems Create automated testing frameworks using Python to validate AI model outputs and behaviors Develop test cases that cover edge scenarios and potential failure modes in AI systems Perform thorough regression testing on new releases and feature updates Validate that AI systems meet functional requirements and performance benchmarks Document bugs with clear reproduction steps and expected behaviors Collaborate with AI engineers to understand model architectures and potential weak points Support the development team in troubleshooting and resolving identified issues Assist with agentic development projects during periods of lower QA workload Requirements Experience in software QA, with a focus on Python Strong Python programming skills and experience with testing frameworks (pytest, unittest) Understanding of AI concepts, machine learning workflows, and LLM evaluation techniques Experience testing complex systems with multiple integrations Familiarity with CI/CD pipelines and test automation Knowledge of version control systems (Git) Experience with bug tracking and project management tools Nice to Have Experience with AI-specific testing methodologies and evaluation metrics Understanding of LLM evaluation techniques (including hallucination detection, bias testing) Background in agentic system development or testing Experience with containerization (Docker) and orchestration tools Knowledge of API testing (Postman, requests) Familiarity with prompt engineering and prompt testing methodologies What You'll Do Develop comprehensive test plans for new AI features and systems Build and maintain automated test suites that validate model outputs against expected benchmarks Create specialized tests for agentic behaviors and decision-making processes Collaborate with cross-functional teams to define quality standards and acceptance criteria Participate in code reviews from a quality assurance perspective Contribute to agentic development projects when QA workload allows Help establish testing best practices for AI and agentic systems This position offers the opportunity to work at the cutting edge of AI quality assurance while developing skills in agentic system development. Join us in building reliable, high-quality AI products that our customers can trust.
Posted 1 month ago
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Accenture
36723 Jobs | Dublin
Wipro
11788 Jobs | Bengaluru
EY
8277 Jobs | London
IBM
6362 Jobs | Armonk
Amazon
6322 Jobs | Seattle,WA
Oracle
5543 Jobs | Redwood City
Capgemini
5131 Jobs | Paris,France
Uplers
4724 Jobs | Ahmedabad
Infosys
4329 Jobs | Bangalore,Karnataka
Accenture in India
4290 Jobs | Dublin 2