AI Test Engineer

Job Description

Design and develop comprehensive test plans for AI algorithms, covering various aspects like functionality, performance, and robustness. Execute test cases, including sanity checks, edge case scenarios, and stress tests, to evaluate algorithm performance under different conditions. Proactively identify potential failure modes and vulnerabilities in AI algorithms through rigorous testing and analysis. Develop and maintain automated test suites for efficient and repeatable testing. Analyze test results, identify defects, and report them clearly and concisely to the development team. Collaborate closely with AI engineers and data scientists to understand algorithm design and identify areas of potential weakness. Stay up-to-date with the latest advancements in AI testing methodologies and tools. Contribute to the improvement of our AI testing processes and best practices. Document test plans, test cases, and test results thoroughly. Triage algorithm-related defects reported from the field, analyzing logs, data, and user feedback to identify root causes and prioritize fixes. Work with the development team to reproduce field issues in a controlled environment and develop appropriate tests to prevent regressions. Requirement Bachelors degree in Computer Science, Engineering, or a related field. Proven experience of at least 3 yrs in software testing, preferably with a focus on AI or machine learning systems. Strong understanding of AI/ML concepts and algorithms. Proficiency in Python. Experience with test automation frameworks and tools. Ability to think critically and creatively to design effective test cases. Strong communication and collaboration skills. Experience with data analysis and visualization tools. Passion for AI and a desire to contribute to the development of robust and reliable AI systems.