Quality Assurance Automation Engineer

About the Role

We are seeking an experienced QA Automation Engineer to strengthen our quality assurance team for our AI-driven conversational platform. The ideal candidate should have a strong foundation in software testing principles, hands-on experience with automation frameworks, and a keen interest in testing NLP or AI-based applications. 

Key Responsibilities

• Design, develop, and maintain automated test scripts using tools such as Playwright, Selenium, or Appium.
• Develop automation strategies for testing AI-driven chat interfaces, APIs, and NLP model integrations.
• Conduct functional, regression, integration, usability, and performance testing of AI-based web applications.
• Validate conversational flows, API responses, and ensure accuracy, consistency, and contextual relevance of AI responses.
• Work closely with developers, ML engineers, and product managers to understand feature behavior and ensure comprehensive test coverage.
• Integrate automated tests with CI/CD pipelines (e.g., Jenkins, GitHub Actions, GitLab CI).
• Identify, isolate, and report defects with detailed logs, screenshots, and test data.
• Create and maintain test data sets for conversational and contextual validation scenarios.
• Analyze automation results and provide insights for continuous product quality improvement.
• Mentor and guide junior QA engineers to strengthen automation and testing best practices.
• Stay current with AI/NLP testing methodologies, automation tools, and emerging QA practices.
• Follow secure development, testing, and deployment guidelines to ensure data integrity and compliance.

Requirements

• Bachelor’s degree in Computer Science, Information Technology, or equivalent experience.
• 3+ years of experience in QA automation for web or SaaS platforms.
• Strong proficiency in Python, Java, or JavaScript for test automation.
• Proficiency in API testing using Postman, RestAssured, or similar tools.
• Familiarity with testing AI or NLP-based systems is a strong plus.
• Solid understanding of SDLC, STLC, Agile/Scrum methodologies.
• Experience with Git, JIRA, and CI/CD integration.
• Strong analytical and problem-solving skills with attention to edge cases and response accuracy.
• Experience in writing MySQL/SQL queries for validation and data-driven testing.
• Excellent communication and collaboration skills for working in cross-functional teams.
• Strong attention to detail and quality-driven mindset.

Preferred Skills



• Exposure to testing AI model APIs, prompt-response evaluation, or conversational workflows.
• Familiarity with performance testing tools (JMeter) and monitoring AI performance metrics (latency, response relevance).
• Knowledge of cloud environments (AWS, Azure, or GCP).