AI Test Lead

As an AI Tester at Lilly, you will play a crucial role in ensuring the quality and performance of AI-based solutions that are set to revolutionize the pharmaceutical industry by 2025. Your responsibilities will include: - Collaborating with cross-functional teams to develop comprehensive AI testing strategies and plans for AI-powered applications. - Designing, developing, and executing test cases for AI systems and models, including machine learning and deep learning algorithms. - Testing AI models for accuracy, precision, recall, F1 score, and fairness to ensure unbiased decision-making processes. - Developing and implementing automated testing scripts and frameworks specifically designed for AI applications. To excel in this role, you should possess: - Strong knowledge of AI/ML testing methodologies and best practices. - Experience with AI development frameworks and libraries such as TensorFlow, Keras, PyTorch, scikit-learn, and MLlib. - Proficiency in testing tools and environments for AI-based systems like Jupyter Notebooks, Apache Spark, and DataRobot. - Knowledge of Python, R, JavaScript, or other programming languages frequently used in AI/ML. - Familiarity with cloud technologies like Microsoft Azure and AWS. - Understanding of test automation frameworks and experience in tools like Cypress, Playwright, and Pytest for automating AI tests. In addition to technical expertise, you should also demonstrate: - Strong problem-solving abilities and keen attention to detail in diagnosing and resolving AI-related issues. - Excellent teamwork and communication skills to collaborate effectively with cross-functional teams. - Minimum of 8+ years of experience in software testing, with at least 2 years focused on testing AI/ML models or AI-based applications. Preferred qualifications include experience with cloud platforms for deploying AI applications, familiarity with DevOps practices, and certification in AI/ML or related testing frameworks. If you are passionate about AI, testing, and making a difference in healthcare, this AI Tester role at Lilly offers a unique opportunity to shape the future of AI in the pharmaceutical industry. Apply now to be a part of our mission to unite caring with discovery and make life better for people around the world.,