Testing - DET - Staff

As an AI Test Engineer at EY, you will be part of a dynamic team focused on testing AI models and systems to ensure quality and performance standards are met. Your role will involve collaborating with experienced engineers and data scientists to gain hands-on experience in AI testing. **Key Responsibilities:** - **Test case design:** - Have a good understanding of testing touch points in a model development lifecycle. - Participate in discussions with team members to understand testing needs. - Support the development of test cases based on project requirements. - Define test cases to validate input data, Model functional performance, Model response, etc. - **Test Execution:** - Execute manual tests for AI models and document results. - Prior experience in performing AI-specific testing methods like Pairwise testing, Metamorphic testing, Back-to-Back testing, Bias Testing, Drift testing, etc. - Knowledge of responsible AI testing and explainability testing tools (e.g., LIME, SHAP). - Assist in running automated tests and analyzing their outcomes. - **Model Validation Support:** - Help validate AI models against performance metrics such as accuracy and recall. - Conduct exploratory testing to identify potential issues. - Exposure to testing LLM models. - **Data Quality Checks:** - Collaborate with data teams to ensure the quality of datasets used in testing. - Participate in data validation activities to maintain data integrity. - Prior experience in performing various data validation activities like data collection/generation, data augmentation, Exploratory data analysis, data bias, and privacy, etc. - **Documentation:** - Document test results and maintain clear records of defects found during testing. - Prepare summary reports of testing activities for review. - **Learning and Development:** - Stay informed about AI testing best practices and tools. - Seek guidance from senior engineers to improve testing skills and knowledge. **Qualifications Required:** - Bachelors degree in Computer Science, Engineering, or a related field; Masters degree preferred. **Additional Details:** At EY, the mission is to build a better working world by creating new value for clients, people, society, and the planet, while building trust in capital markets. EY teams work across a full spectrum of services in assurance, consulting, tax, strategy, and transactions, fueled by sector insights, a globally connected network, and diverse ecosystem partners.,