4 Ai Testing Jobs

Work Experience: Overall 10+ years of quality engineering experience with DWH/ETL for enterprise grade applications Hands on experience with functional, non-functional and automation of products Hands on experience with leverage LLMs/GenAI for improving efficiency & effectiveness of overall delivery process Role & Responsibilities: Leading end-to-end QE for product suite Authoring QE test strategy for a release and executing it for a release Driving quality releases by closely working with development, PMs, DevOps, support and business teams Achieving automation coverage for product suite with good line coverage Manage risks and resolves issues that affect release scope, schedule and quality Work with product teams to understand impacts of branches and code merges, etc. Lead and co-ordinate the release activities including the execution of overall Ability to lead team of SDETs and help them in addressing their issues Mentoring and coaching members in the team Technical Skills: Experience in ETL / BI Testing, using any ETL and Reporting Tool with Oracle / SQL Server / as Database Exposure to Data Warehousing and Dimensional Modelling Concepts Hands-on with coding preferably Python Extensive experience in writing and troubleshooting SQL Queries Ability to achieve good functional coverage of product suite Hands on experience with automation tools (Selenium, TestNg, etc.) Experience with CI/CD tools e.g., Jenkins Experience with tools like JIRA, Confluence, SharePoint, TestRails, Zephyr etc. Experience with performance, volume and stress testing Solid understanding of cloud services platforms e.g., AWS, GCP, Azure etc. Well versed with DBs and SQLs Hand-on experience with GenAI/LLMs/RAGs/Agents Soft Skills: Excellent communication skills. Ability to convey hard/sensitive messages without any apprehensions as well as avoid creating frictions. Ability to navigate thru organization independently.

About the Role We're seeking a skilled Python QA Analyst to join our team focused on AI and agentic systems. In this role, you'll ensure the quality and reliability of our AI products while occasionally supporting agentic development during periods of lower QA workload. Key Responsibilities Design, implement and maintain comprehensive test suites for AI and agentic systems Create automated testing frameworks using Python to validate AI model outputs and behaviors Develop test cases that cover edge scenarios and potential failure modes in AI systems Perform thorough regression testing on new releases and feature updates Validate that AI systems meet functional requirements and performance benchmarks Document bugs with clear reproduction steps and expected behaviors Collaborate with AI engineers to understand model architectures and potential weak points Support the development team in troubleshooting and resolving identified issues Assist with agentic development projects during periods of lower QA workload Requirements Experience in software QA, with a focus on Python Strong Python programming skills and experience with testing frameworks (pytest, unittest) Understanding of AI concepts, machine learning workflows, and LLM evaluation techniques Experience testing complex systems with multiple integrations Familiarity with CI/CD pipelines and test automation Knowledge of version control systems (Git) Experience with bug tracking and project management tools Nice to Have Experience with AI-specific testing methodologies and evaluation metrics Understanding of LLM evaluation techniques (including hallucination detection, bias testing) Background in agentic system development or testing Experience with containerization (Docker) and orchestration tools Knowledge of API testing (Postman, requests) Familiarity with prompt engineering and prompt testing methodologies What You'll Do Develop comprehensive test plans for new AI features and systems Build and maintain automated test suites that validate model outputs against expected benchmarks Create specialized tests for agentic behaviors and decision-making processes Collaborate with cross-functional teams to define quality standards and acceptance criteria Participate in code reviews from a quality assurance perspective Contribute to agentic development projects when QA workload allows Help establish testing best practices for AI and agentic systems This position offers the opportunity to work at the cutting edge of AI quality assurance while developing skills in agentic system development. Join us in building reliable, high-quality AI products that our customers can trust.

Position Summary: We value our talented employees, and whenever possible strive to help one of our associates grow professionally before recruiting new talent to our open positions. If you think the open position you see is right for you, we encourage you to apply! Our people make all the difference in our success. We are seeking a skilled and detail-oriented QA Engineer to join our AI team. You will play a pivotal role in ensuring the reliability, accuracy, and scalability of AI-integrated backend systems and workflows. Working closely with the Development team and the Technical Product Owner, you will design and execute testing strategies to validate backend services, APIs, and AI functionality, ensuring seamless integration and exceptional performance. This role is perfect for someone with strong experience in backend testing, API validation, and automation, who is enthusiastic about testing AI capabilities within complex systems. Key Responsibilities: Collaborate with the team of developers, system to understand system requirements, workflows, and AI integration goals. Design, document, and execute test plans and strategies for backend systems and AI-enabled applications. Develop and maintain automated test scripts for APIs and system integrations using tools like Postman, Cypress, or Pytest . Validate AI outputs, workflows, and models to ensure they meet functional and performance standards. Conduct functional, regression, integration, and performance testing for APIs, databases, and cloud systems. Proactive in developing automated test suites. Identify, document, and track bugs and issues using tools like JIRA . Stay updated on AI testing tools and techniques, contributing to the teams knowledge of best practices for validating AI-driven systems. Desired Qualifications: 8 to 11 years of experience in QA engineering, with a focus on backend testing and API validation . Strong knowledge of Python for writing test scripts and automation frameworks. Hands-on experience with API testing tools (Postman, RestAssured, etc.). Familiarity with test automation frameworks like Cypress, Pytest, or Robot Framework. Understanding of AI testing methodologies , such as validating model accuracy, bias, and performance (a plus). Experience working with cloud platforms (AWS preferred) for validating cloud-based services. Experience working with AI Agentic architecture & Langchain, Langsmith & Langraph (Nice to Have) Strong problem-solving and debugging skills for backend system testing. Excellent communication skills to collaborate effectively with technical and non-technical stakeholders. What We Are Looking For: A QA engineer with a strong backend testing focus, eager to explore AI system validation. A team player who can collaborate with developers and product owners to ensure high-quality deliverables. Someone who is adaptable and ready to learn new AI tools and frameworks as needed. Education and Training Required: Degree in Computer Science, Artificial Intelligence, or a related field. Location & Hours of Work Full-time position, working 40 hours per week. Expected overlap with US hours as appropriate. Primarily based in the Innovation Hub in Hyderabad, India, with flexibility to work remotely as required.

Senior QA Engineer to lead end-to-end product quality efforts. You'll develop test automation, ensure seamless Agile collaboration, and enhance CI/CD pipelines. Expertise in Selenium, API testing, Jira, and cloud platforms is key.