Role Summary:
As a QA AI Engineer you will support the delivery of high-quality digital experiences across customer-facing applications. In this role, you will partner closely with developers, product owners, business analysts, and fellow QA engineers to learn our systems, understand business processes, and contribute to quality throughout the software development lifecycle. You will execute testing activities, identify defects, and help ensure customers receive reliable and intuitive digital experiences.
Responsibilities:
- Execute functional, regression, integration, and exploratory testing for web based AI Chatbot applications.
- Develop a strong understanding of company’s digital platforms, business processes, and customer experiences.
- Collaborate with cross-functional teams to understand requirements, user stories, and acceptance criteria.
- Identify, document, and track software defects, AI hallucination, incomplete answers, incorrect content retrieval, access control violations, prompt injection vulnerabilities, while effectively communicating findings to development teams.
- Participate in backlog refinement, sprint planning, daily standups, and other Agile ceremonies.
- Create and maintain test plans, test scenarios, test cases, test data, and QA documentation.
- Assist with validation of website content, product information, and customer-facing functionality.
- Apply quality engineering best practices, testing methodologies, and automation tools.
- Support user acceptance testing and release validation activities.
- Communicate testing status, risks, and issues clearly to team members and stakeholders.
- Continuously expand technical knowledge of the applications, systems, and technologies used within the organization.
- Perform other duties as assigned.
Qualifications:
- Bachelor's degree in Computer Science, Information Technology, Engineering, or equivalent experience.
- 1-3 years of experience in AI Quality Assurance, ML\AI Testing in data platforms like Databricks, or a related field.
- Knowledge of AI web technologies, APIs, hands-on experience with creating Agentic AI, and development experience in data platforms like Databricks.
- Understanding of software development and testing concepts.
- Strong verbal and written communication skills.
- Demonstrated ability to collaborate effectively within cross-functional teams.
- Strong organizational, analytical, and problem-solving skills.
- A desire to learn new technologies, systems, and business processes.
- Ability to manage multiple priorities in a fast-paced environment.
- Familiarity with Agile methodologies is preferred.
Preferred Experience:
- Experience with AI chatbot testing using data housed in Databricks, AI behavior across user personas and permissions, AI context retention, AI response quality, AI data validation, RAG validation, and data architecture.
- Experience testing product information management (PIM) systems, digital asset management systems, or product data platforms.
- Familiarity with .NET, ecommerce platforms and customer-facing configurator experiences.
- Experience with Azure DevOps, GitHub Actions, or similar CI/CD platforms.
- Knowledge of accessibility standards (WCAG) and SEO best practices.
- Experience in quality engineering and continuous improvement practices.
Pay: ₹77,300.00 - ₹134,000.00 per month
Benefits:
- Provident Fund
- Work from home
Application Question(s):
- Are you willing to provide a valid ID for verification purposes?
- Are you willing to attend an onsite interview for the final stage of the process?
- How many years of hands-on experience do you have as a QA Engineer?
- How many years of hands-on experience do you have in AI Testing
Location:
- Bangalore City, Bengaluru, Karnataka (Required)
Work Location: Remote
