Quality Assurance Engineer (Gen AI)

About the Role

We are seeking an experienced QA Engineer who is self-motivated, looking for a rewarding challenge, ready to learn the new and leading-edge Microsoft Azure Open AI, and is eager to start providing manual and automated software testing assistance from day one to a currently strong and varied team. The ideal candidate would have an education in Computer Science with a focus on Generative AI and related experience as a power-user of Microsoft SharePoint, iManage Work or NetDocuments document management systems. 

This role also requires hands-on exposure to DevOps-related technologies as well. You'll work closely with engineers and product teams to build and maintain automation frameworks, ensure high-quality software releases, and validate the reliability of Gen AI powered apps. This is a hybrid position based in Newark, NJ or fully remote for qualified candidates. Selected Candidates are required to start immediately or within the next 2 weeks.

Key Responsibilities

• Design, build, and execute test plans for Gen AI-driven applications and backend systems.
• Automate testing workflows and integrate them into CI/CD pipelines.
• Validate Gen AI LLM model outputs for accuracy, fairness, and performance.
• Conduct functional, regression, exploration, and performance testing.
• Document and track issues, working with developers to resolve them quickly
• Collaborate cross-functionally to define QA standards and release criteria
• Continuously improve test coverage, tools, and practices.
• Execute and evaluate detailed manual and automated test cases, report test results, and identify potential improvements.
• Create detailed, clear and well-structured test plans, execute test cases and test scripts on multiple products.
• Apply repetitive testing of functions within various browsers and/or devices.

Key Qualifications

• Minimum of 5 years QA experience in an automated testing environment with proficiency in developing complex automation scripts.
• Proficiency with Playwright, Selenium, or other automation frameworks
• Skilled in scripting languages such as Python, JavaScript, or .NET.
• Strong grasp of AI testing methodologies (A/B testing, adversarial, white box).
• Ability to consistently create, enhance, and drive the automated testing process to ensure efficient and comprehensive test coverage.
• Ability and willingness to learn new technologies with a strong focus on automation tools and techniques.
• Superior analytical, strategic and problem-solving capabilities.
• Excellent organizational and leadership skills.
• Proficient communication and interpersonal abilities to communicate effectively across product teams.
• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Agile Testing Automation Certification a plus.
• Familiarity with Open AI 4o and Microsoft Azure.
• Familiarity with HTML, CSS and JavaScript with experience in integrating automated testing with these technologies.
• Familiarity with Angular, React or similar framework a plus.
• Familiarity with SCRUM and Secure SDLC processes.
• Ability to facilitate meetings with individuals and groups to gather, understand and articulate their business needs.
• Analytical skills, to critically evaluate the information gathered from multiple sources, reconcile conflicts, and decompose high-level information into clear potential deliverables.

What We Offer

• Fully remote, flexible work from anywhere in India.
• Competitive pay, comprehensive benefits, and career growth opportunities.
• Access to the latest tech, trends, and international projects.