Work from Office
Full Time
Key Responsibilities: Strong software quality basics and aptitude Collaborate with Applied AI Engineers and Data Scientists to design and implement procedures to validate AI products on LLMs for accuracy, benchmarking, and functionality. Maintain detailed records of all validation activities, including test methods, results, and any issues encountered Evaluate test data to determine whether AI systems or processes have met validation criteria and identify areas for improvement Suggest tools and methodologies for efficient validation and benchmarking of AI products. Automate validation steps / tasks to improve efficiency in validation and benchmarking. Assist in creating sample datasets for benchmarking and functionality tests. Ensure the AI products meet the required standards and specifications. Provide insights and recommendations for improving AI product performance. Keep up-to-date with evolving industry standards, technological advancements, and best practices and new trends in AI validation Proven experience delivering high-quality outcomes in fast-paced, agile environments. Qualifications: Bachelors degree in computer science, Engineering, Data Science, or a related field. 4 to 8 years of experience in AI Engineering, data science, AI validation or a related field. Strong Experience with validation and benchmarking of AI products. Good understanding of AI and machine learning concepts, particularly LLMs. Familiarity with tools and methodologies for AI validation and benchmarking. Excellent documentation and communication skills. Ability to work collaboratively in a team environment. Strong problem-solving skills and attention to detail.
Icertis
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
Pune
15.0 - 22.5 Lacs P.A.
6.0 - 7.0 Lacs P.A.
2.5 - 4.0 Lacs P.A.
Bengaluru
4.0 - 5.0 Lacs P.A.
7.0 - 11.0 Lacs P.A.
5.0 - 10.0 Lacs P.A.
Pune
15.0 - 22.5 Lacs P.A.
Faridabad
3.0 - 3.5 Lacs P.A.
Bengaluru
Experience: Not specified
2.4 - 3.0 Lacs P.A.
Sri City, Chennai
6.0 - 10.0 Lacs P.A.
