QA Engineer

Overview:

We are looking for a highly skilled and motivated QA Engineer with over 3 years of experience to join our dynamic AI team. The ideal candidate will be responsible for ensuring the quality, reliability, and performance of our AI-powered products. This role requires a deep understanding of both traditional QA methodologies and the unique challenges of testing AI and machine learning systems. You will be instrumental in developing and executing sophisticated testing strategies that cover everything from backend APIs to the intricacies of AI model behaviour, including accuracy, bias, and robustness.

Key Responsibilities:

• Design, develop, and execute comprehensive test plans for our AI-driven applications, covering functional, regression, and performance testing.
• Create and maintain automated testing frameworks for our backend services (FastAPI) and AI models using tools like PyTest, Selenium, and Postman.
• Perform rigorous manual and automated testing of AI features, with a strong focus on identifying and documenting defects in a clear and actionable manner.
• Dive deep into AI model testing, including assessing model accuracy, identifying biases, and exploring edge cases.
• Engage in "jailbreaking" and other adversarial testing techniques to ensure the robustness and security of our AI models against unexpected or malicious inputs.
• Implement and utilize observability tools to monitor model performance, data drift, and other key metrics in real-time.
• Collaborate closely with developers and AI/ML engineers to identify, troubleshoot, and resolve defects in a timely manner.
• Use load testing tools to simulate and analyse the performance of AI workloads, particularly those involving Kafka and Redis.
• Ensure all our AI product releases meet the highest quality standards and comply with all relevant regulations.
• Document all test cases, test results, and quality metrics to provide clear insights into product quality.

Required Qualifications:

• 3+ years of hands-on experience in a quality assurance or testing role.
• Proven proficiency with automation tools such as Selenium, PyTest, and Postman.
• Strong experience in testing backend services, APIs, and databases (PostgreSQL, Redis).
• Solid understanding of CI/CD pipelines and agile testing methodologies.
• Exceptional analytical and problem-solving skills, with meticulous attention to detail.

Job Type: Contractual / Temporary

Pay: ₹420,000.00 - ₹540,000.00 per year

Ability to commute/relocate:

• Narhe, Pune, Maharashtra: Reliably commute or planning to relocate before starting work (Required)

Application Question(s):

• Will you be available for face to face interview?

Experience:

• Quality assurance: 3 years (Required)

Work Location: In person