Testing - Automation-Senior

As a Machine Learning Model Validation Consultant at EY, you will focus on validating and testing AI/ML-enabled systems used in highly regulated industries like pharmaceuticals and life sciences, ensuring they comply with GxP/GMP standards. Your responsibilities will include: - **AI/ML System Validation**: - Test and validate AI/ML models for accuracy, fairness, and compliance. - Apply metrics like confusion matrices, precision, recall, and F1 scores to evaluate model performance. - Validate both traditional ML models and LLM or RAG systems. - **Compliance & Regulatory Testing**: - Design and execute validation strategies meeting GxP/GMP requirements. - Ensure transparency, auditability, and safety of AI/ML systems in regulated environments. - **Integration Testing**: - Test new components and features added to existing platforms. - Ensure smooth functioning and accurate outputs of integrations like AI tools, ML models, or rule-based systems. - **Data Validation & Engineering Support**: - Validate data quality, consistency, and reliability in data pipelines for AI/ML models. - Collaborate with data engineering teams to ensure clean and compliant data flows. - **End-to-End Output Validation**: - Confirm accuracy, explainability, and compliance of final system outputs with business/regulatory requirements. - Document results clearly for auditors and stakeholders. **Required Skills**: - Understanding of Machine Learning concepts such as classification, regression, and confusion matrix. - Knowledge of LLMs, RAG, and AI validation techniques. - Familiarity with GxP/GMP compliance standards and regulated IT environments. - Strong skills in data engineering concepts like data pipelines and quality checks. - Ability to design test strategies and document validation evidence. **Nice to Have**: - Experience with cloud-based ML/AI platforms. - Familiarity with rule-based systems and their validation. - Strong analytical and problem-solving skills. At EY, our mission is to build a better working world by creating long-term value for clients, people, and society, while fostering trust in capital markets. Our diverse teams in over 150 countries leverage data and technology to provide assurance and support clients in their growth, transformation, and operations across various sectors. Join us in asking better questions to find innovative solutions for the complex challenges of today's world.,