QA Engineer/Tester AI/ML (SDET)

As a QA Engineer, you will play a crucial role in ensuring the quality and reliability of our software applications. You will be responsible for designing, implementing, and executing automated tests, focusing on applications that incorporate AI and ML components. Your expertise in Playwright will help enhance our testing framework, and you will work closely with developers and data scientists to deliver high-quality software solutions.

Responsibilities:

Test Strategy & Planning:

● Develop test plans, test cases, and test scripts tailored for chatbot interactions and report generation.

● Defi ne test strategies for LLM-based chatbot validation and output verifi cation.

● Ensure comprehensive functional, regression, performance, and security testing.

Chatbot-Specific Testing:

● Validate chatbot responses for accuracy, relevance, consistency, and hallucination detection.

● Test prompt variations and evaluate LLM-generated responses across different user intents.

Automation & API Testing:

● Write automation scripts for conversational fl ows, user interactions, and report generation using Playwright

● Implement API testing (Postman, RestAssured, or similar) for LLM interactions, backend workfl ows, and data retrieval.

● Automate test cases for prompt injection security, rate limits, and bot performance.

Performance & Load Testing (Good to have):

● Conduct load and stress testing to measure the chatbot’s response time under concurrent usage.

● Identify and optimize latency issues in chatbot responses.

● Use tools like JMeter, Locust, or k6 for performance analysis.

User Experience (UX) Testing:

● Validate chatbot UI/UX across web and mobile platforms.

● Conduct usability testing to ensure smooth and natural conversations.

● Identify edge cases and error-handling improvements.

Regression & Continuous Testing:

● Maintain an automated regression suite to validate updates and model retraining.

● Work closely with developers and DevOps teams to integrate tests into CI/CD pipelines (Jenkins, GitHub Actions, GitLab CI/CD).

Data Integrity & Report Validation:

● Ensure accuracy of generated reports (format, structure, and consistency).

Bug Reporting & Documentation:

● Log and track bugs in Jira, Trello, or similar tools with detailed repro steps.

● Provide test reports and work with developers to prioritize fi xes.

● Contribute to QA documentation for test cases, automation setups, and best practices.

Requirements:

● Bachelor’s degree in Computer Science, Software Engineering, or a related field.

● 3-6 years of experience in software quality assurance with a strong focus on automation testing.

● Proven experience with Playwright or similar testing frameworks (e.g., Selenium, Cypress).

● Solid understanding of AI and ML principles and their application in software.

● Experience developing and implementing automated tests for web applications.

● Strong programming skills in languages such as JavaScript, Python, or Java.

● Familiarity with API testing and tools such as Postman or REST Assured.

● Profi cient in version control systems such as Git.

● Strong analytical and troubleshooting skills.

● Excellent communication and collaboration abilities.