Testing - DET - Staff- E

Role Overview: As a staff AI Test Engineer at EY, you will have the opportunity to join the AI Testing team and assist in developing and executing test cases for AI models and systems. You will work alongside experienced engineers and data scientists to ensure that AI models meet quality and performance standards. This role will provide you with hands-on experience in AI testing and the chance to contribute to building a better working world. Key Responsibilities: - **Test case design:** - Demonstrate a good understanding of the various testing touchpoints in a model development lifecycle. - Participate in discussions with team members to understand testing needs. - Support the development of test cases based on project requirements. - Define test cases to validate input data, Model functional performance, Model response, etc. - **Test Execution:** - Execute manual tests for AI models and document results. - Utilize AI-specific testing methods like Pairwise testing, Metamorphic testing, Back-to-Back testing, Bias Testing, Drift testing, etc. - Apply knowledge of responsible AI testing and explainability testing tools (e.g., LIME, SHAP). - Assist in running automated tests and analyzing their outcomes. - **Model Validation Support:** - Help validate AI models against performance metrics such as accuracy and recall. - Conduct exploratory testing to identify potential issues. - Gain exposure to testing LLM models. - **Data Quality Checks:** - Collaborate with data teams to ensure the quality of datasets used in testing. - Participate in data validation activities to maintain data integrity. - Perform various data validation activities like data collection/generation, data augmentation, Exploratory data analysis, data bias, and privacy checks. - **Documentation:** - Document test results and maintain clear records of defects found during testing. - Prepare summary reports of testing activities for review. - **Learning and Development:** - Stay informed about AI testing best practices and tools. - Seek guidance from senior engineers to enhance testing skills and knowledge. Qualification Required: - **Education:** Bachelors degree in Computer Science, Engineering, or a related field; Masters degree preferred. - **Experience:** 1-4 years of experience in software testing/development with exposure to Python, 1+ years in testing on AI/ML applications. - **Technical Skills:** - Basic understanding of AI/ML concepts and algorithms. - Familiarity with programming languages such as Python or Java is a plus. - Exposure to software testing principles and practices. - Strong analytical and problem-solving skills. - Attention to detail and a commitment to quality. - Experience with testing tools (e.g., Selenium, PyTest) through coursework or internships. - Knowledge of version control systems (e.g., Git) is a plus. - Experience with Agile methodologies is a bonus. You will be part of the EY team that is dedicated to building a better working world by creating new value for clients, people, society, and the planet. EY leverages data, AI, and advanced technology to help clients shape the future with confidence and address the most pressing issues of today and tomorrow. With a global presence in more than 150 countries and territories, EY offers a full spectrum of services in assurance, consulting, tax, strategy, and transactions.,