Senior QA Engineer – AI Platform Testing

Job Title: QA Engineer – AI Platform Testing

About the Role:

Key Responsibilities:

• Design, write, and execute test cases to validate features, APIs, and end-to-end system integrations.

• Java-based frameworks

• Conduct manual and exploratory testing for AI model outputs and user workflows.

• Validate training datasets, detect anomalies, and evaluate model-generated content.

• Log and track defects with comprehensive documentation using bug tracking tools.

• Collaborate closely with Machine Learning, Development, and Automation teams to define test strategies and acceptance criteria.

• Contribute to regression testing cycles and final release validations.

Required Skills & Qualifications:

• 5+ years of professional experience in QA or software testing.

• QA automation using Java

• Solid understanding of Agile methodologies, QA processes, and test lifecycle management.

• Hands-on experience with test management tools (TestRail, Zephyr) and defect tracking tools (JIRA, Azure DevOps).

• Strong experience with API testing tools such as Postman.

• Excellent analytical skills and attention to detail.

• Preferred (Nice to Have):

  • Exposure to AI/ML concepts, particularly around testing LLM outputs, computer vision, or NLP systems.

  • Experience validating training data quality and evaluating model behavior in production environments.

About NorthBay Solutions: