Senior Test Engineer

Job Title :: Artificial Intelligence Quality Assurance Test Engineer

Location :: India (Remote)

Minimum relevant experience :: 6

Top Skills/Must have Skills:

• GenAI, Prompt Testing & Agentic AI Validation
• Responsible AI, Model Quality & Data Validation
• Functional, Integration & System Testing for AI Applications
• Technical QA Skills – Python, Tosca/Selenium

• We are seeking a highly skilled and experienced Artificial Intelligence Quality Assurance Test Engineer to join our dynamic team. In this role, you will be instrumental in ensuring the quality, reliability and ethical integrity of our advanced inhouse developed AI solutions, particularly those leveraging Generative AI and Agentic AI. You will work on production-grade systems, moving beyond proof-of-concept to deliver robust, client-ready products.

Your professional experience:

Must have:

• Experience of test automations and tools, e.g. Tosca, Python, Selenium
• Strong knowledge & use of QA methodologies e.g. Agile, Waterfall, DevOps, BDD for functional test activities.
• Proven experience as a Quality Assurance Engineer, with a significant focus on testing Artificial Intelligence and Machine Learning products.
• Agentic AI Agent testing and validation.
• Strong knowledge of Responsible AI principles and practices, including experience in testing for fairness, bias detection, explainability, privacy, and security in AI systems.
• Familiarity with Agentic AI concepts and architectures.
• Experience in working with teams in DevSecOps
• In-depth knowledge of test toolsets and development languages including C#, Java
• Solid understanding and practical experience in testing Generative AI (GenAI) Solutions, including evaluating model outputs, prompt engineering, and understanding the nuances of generative models.
• Understanding of DevOps pipeline i.e. change, release & deployment processes
• Experience in conducting UAT, defect reporting & triage and preparing QA metrics
• Understanding across multiple disciplines of test, e.g. functional, integration, performance, compatibility
• ISTQB Foundation Level certificate (or equivalent experience)
• Test management tool expertise (such as Atlassian Jira, Azure DevOps etc.)
• Strong written, verbal and presentation skills
• Professional and confident with a strong drive & enthusiasm to multi-task.
• Acute attention to detail.

Desirable experience:

• A proven track record in a top tier consultancy or a large enterprise / organisation.
• Direct experience in testing Agentic AI Solutions, including evaluating agent behaviour, goal achievement, and interaction patterns.
• Experience with performance testing and load testing of AI models and applications.
• Knowledge of data governance and data quality best practices in an AI context.
• ISTQB Certified Agile Tester qualification
• ISTQB Certified AI Tester qualification

About Ascendion:

• Ascendion is transforming the future of technology with AI-driven software engineering.
• Our global team accelerates innovation and delivers future-ready solutions for some of the world’s most important industry leaders.
• Our applied AI, software engineering, cloud, data, experience design, and talent transformation capabilities accelerate innovation for Global 2000 clients.
• Join us to build transformative experiences, pioneer cutting-edge solutions, and thrive in a vibrant, inclusive culture - powered by AI and driven by bold ideas.