Senior AI Python Quality Analyst

As a Senior AI Python Quality Analyst, you play a crucial role in ensuring the reliability and quality of cutting-edge AI products and agentic systems. Your responsibilities include: - Designing, implementing, and maintaining robust test suites for AI and agentic systems. - Building automated testing frameworks in Python to validate AI model outputs and system behavior. - Developing test cases for edge cases, failure modes, and model misbehavior such as hallucinations and biases. - Performing thorough regression testing for all releases and updates. - Ensuring AI systems meet performance benchmarks and functional requirements. - Collaborating with AI engineers to understand architectures and identify weak points. - Documenting and tracking bugs with detailed reproduction steps. - Supporting development in debugging and issue resolution. - Participating in agentic development during reduced QA workload. Qualifications required for this role include: - 5+ years of experience in Software QA, with a focus on Python. - Proficiency in Python testing frameworks like pytest and unittest. - Familiarity with AI/ML workflows and evaluation methodologies. - Experience testing complex, integrated systems. - Solid understanding of CI/CD pipelines, version control (Git), and test automation. - Comfort with bug tracking tools and collaborative development environments.,