QA Engineer/Tester AI/ML (SDET)

As a Quality Assurance (QA) Engineer, you will have a pivotal role in upholding the quality and dependability of our software applications. Your primary responsibilities include designing, executing, and automating tests, particularly focusing on applications integrated with Artificial Intelligence (AI) and Machine Learning (ML) components. Your proficiency in Playwright will be instrumental in refining our testing framework. Collaboration with developers and data scientists is crucial for delivering top-notch software solutions. Your tasks will include the following: **Test Strategy & Planning:** - Create tailored test plans, cases, and scripts for chatbot interactions and report generation. - Devise test strategies for Language Model (LLM)-based chatbot validation and output verification. - Ensure thorough functional, regression, performance, and security testing. **Chatbot-Specific Testing:** - Verify chatbot responses for accuracy, relevance, consistency, and hallucination detection. - Test various prompt variations and evaluate responses generated by LLM based on different user intents. **Automation & API Testing:** - Develop automation scripts for conversational flows, user interactions, and report generation using Playwright. - Conduct API testing for LLM interactions, backend workflows, and data retrieval using tools like Postman, RestAssured, or similar. - Automate test cases for prompt injection security, rate limits, and bot performance. **Performance & Load Testing (Good to have):** - Perform load and stress testing to assess chatbot response time under concurrent usage. - Identify and enhance latency issues in chatbot responses using tools like JMeter, Locust, or k6. **User Experience (UX) Testing:** - Validate chatbot UI/UX on web and mobile platforms. - Conduct usability testing to ensure seamless and natural conversations. - Identify edge cases and suggest improvements for error handling. **Regression & Continuous Testing:** - Maintain an automated regression suite to validate updates and model retraining. - Collaborate with developers and DevOps teams to seamlessly integrate tests into CI/CD pipelines. **Data Integrity & Report Validation:** - Ensure the accuracy of generated reports in terms of format, structure, and consistency. **Bug Reporting & Documentation:** - Log and monitor bugs in tools like Jira, Trello, or similar platforms with detailed reproducible steps. - Generate test reports and collaborate with developers to prioritize fixes. - Contribute to QA documentation by documenting test cases, automation setups, and best practices. **Requirements:** - Bachelor's degree in Computer Science, Software Engineering, or related field. - 3-6 years of experience in software quality assurance with a focus on automation testing. - Proficiency in Playwright or similar testing frameworks (e.g., Selenium, Cypress). - Sound understanding of AI and ML principles and their application in software. - Experience in developing and implementing automated tests for web applications. - Strong programming skills in languages like JavaScript, Python, or Java. - Familiarity with API testing and tools such as Postman or REST Assured. - Proficient in version control systems like Git. - Strong analytical and troubleshooting skills. - Excellent communication and collaboration abilities.,