Quality Assurance Automation Engineer

We’re looking for someone who loves combining technical skills with problem-solving to keep our data and AI products performing at their best. In this role, you’ll work on test automation - checking, flagging, and safeguarding the quality of large-scale unstructured web crawling, document parsing, GenAI, and agentic solutions - while also helping improve how we work. It’s a great fit if you enjoy switching between detailed testing and big-picture thinking.

About Forage AI

What you’ll do

• Collaborate closely with data operations and engineering teams to align test plans with client requirements
• Design, develop, and maintain automated test scripts using Selenium, HTML, JavaScript, N8N, and Python
• Build and run regression test suites to ensure stability and reliability across datasets
• Design and execute evals for GenAI-powered solutions to measure accuracy, consistency, and edge-case handling
• Provide clear, concise feedback to stakeholders, bridging the gap between technical and non-technical teams
• Identify, document, and track bugs or inconsistencies, ensuring timely resolution
• Support operational workflows by validating data quality and system performance

What we’re looking for

• Relentlessly detail-oriented, with a deep commitment to raising the bar in QA and operations
• Excellent communication skills - able to translate complex findings into actionable insights and act as the bridge between QA and Dev teams
• Strong hands-on experience with Selenium, HTML, JavaScript, XPath, and Python
• Solid understanding of databases, including querying and interacting with them effectively
• At least 2 years of experience working with data and/or QA automation
• Experience collaborating with developers to integrate, orchestrate, and maintain automated QA scripts within the development workflow
• Experience testing AI/GenAI solutions (prompt testing, output validation, error detection)
• Strong foundation in QA principles, automation frameworks, and test case design
• Analytical thinker with the ability to spot patterns and edge cases in large datasets
• Comfortable working in fast-paced, dynamic environments with evolving requirements

Nice to have

• Experience with VBA / Apps Script
• Exposure to AWS systems like S3, DynamoDB, or MongoDB

Other Infrastructure Requirements

Since this is a fully remote position, you will also need:

• High-speed internet connectivity for video calls and efficient work
• A capable business-grade computer (e.g., modern processor, 8GB+ RAM)
• A dedicated home workspace for uninterrupted and efficient work
• Headphones with clear audio quality
• Stable power connection with backup options in case of internet/power outages