Senior QA Engineer – AI Platform Testing

Job Title: QA Engineer – AI Platform Testing

Location:

Experience:

Company:

About The Role

QA Engineer

Key Responsibilities

• Design, write, and execute test cases to validate features, APIs, and end-to-end system integrations.
• Develop and maintain automated test scripts using Java-based frameworks (e.g., Selenium, TestNG, or similar).
• Conduct manual and exploratory testing for AI model outputs and user workflows.
• Validate training datasets, detect anomalies, and evaluate model-generated content.
• Log and track defects with comprehensive documentation using bug tracking tools.
• Collaborate closely with Machine Learning, Development, and Automation teams to define test strategies and acceptance criteria.
• Contribute to regression testing cycles and final release validations.
  

Required Skills & Qualifications

• 5+ years of professional experience in QA or software testing.
• Proven experience in QA automation using Java.
• Solid understanding of Agile methodologies, QA processes, and test lifecycle management.
• Hands-on experience with test management tools (TestRail, Zephyr) and defect tracking tools (JIRA, Azure DevOps).
• Strong experience with API testing tools such as Postman.
• Excellent analytical skills and attention to detail.
• Preferred (Nice to Have):
• Exposure to AI/ML concepts, particularly around testing LLM outputs, computer vision, or NLP systems.
• Experience validating training data quality and evaluating model behavior in production environments.
  

About NorthBay Solutions