20 Ai Evaluation Jobs

As an AI Architect with relevant experience in Natural Language Processing (NLP), Computer Vision (CV), and Large Language Models (LLMs), you will have the responsibility of designing, building, and fine-tuning NLP models and LLM agents to address various business challenges. Your role will involve creating innovative and efficient model designs that elevate user experiences and streamline business processes. Strong design skills, hands-on coding expertise, advanced proficiency in Python development, specialized knowledge in LLM agent design and development, as well as exceptional debugging capabilities are essential for this position. Responsibilities: - Model & Agent Design: You will conce...

Hiring a Python Code Reviewer for a 6-month remote contractual position The ideal candidate should have 4-8 years of experience in Python development, QA, or code review, with a strong grasp of Python syntax, edge cases, debugging, and testing The role involves reviewing annotator evaluations of AI-generated Python code to ensure quality, functional accuracy, and alignment with prompt instructions Experience with Docker, code execution tools, and structured QA workflows is mandatory Strong written communication skills and adherence to quality assurance guidelines (Project Atlas) are required Familiarity with LLM evaluation, RLHF pipelines, or annotation platforms is a plus Location : - Mumba...

Hiring a Python Code Reviewer for a 6-month remote contractual position The ideal candidate should have 4-8 years of experience in Python development, QA, or code review, with a strong grasp of Python syntax, edge cases, debugging, and testing The role involves reviewing annotator evaluations of AI-generated Python code to ensure quality, functional accuracy, and alignment with prompt instructions Experience with Docker, code execution tools, and structured QA workflows is mandatory Strong written communication skills and adherence to quality assurance guidelines (Project Atlas) are required Familiarity with LLM evaluation, RLHF pipelines, or annotation platforms is a plus Location : - Mumba...

Evaluate the model's responses across multiple dimensions to ensure quality and relevance Maintain high standards of speed and precision while assessing the model's responses Strong attention to detail Ability to carefully follow instructions Excellent proficiency in English

Provide high-quality, personalized tutoring sessions focused on Chemistry for JEE Advanced preparation Develop, review, and refine complex chemistry problems, solutions, and explanations for AI training Ensure accuracy, clarity, and logical consistency in the chemistry-related data Evaluate and improve AI-generated physics content, ensuring it aligns with real-world principles Debug and correct errors in AI-driven chemistry reasoning and outputs Collaborate with the AI team to enhance the AIs understanding of Chemistry concepts and problem-solving techniques Create detailed, step-by-step explanations for challenging Chemistry concepts and problems Stay updated with the latest JEE Advanced tr...

Soul AI is a pioneering company founded by IIT Bombay and IIM Ahmedabad alumni, with a strong founding team from IITs, NITs, and BITS. We specialize in delivering high-quality human-curated data, AI-first scaled operations services, and more. Who you are & how you can contribute We are looking for highly skilled and detail-oriented Editor with exceptional abilities in analytics, comprehension, and consistency. If this describes you, we are excited to offer you an incredible opportunity to work remotely as a freelancer. Join us in contributing to the creation of data that powers the training of advanced AI models. Role & Responsibilities: Help in the training of an AI assistant model to enhan...

Soul AI is a pioneering company founded by IIT Bombay and IIM Ahmedabad alumni, with a strong founding team from IITs, NITs, and BITS. We specialize in delivering high-quality human-curated data, AI-first scaled operations services, and more. Who you are & how you can contribute We are looking for highly skilled and detail-oriented Editor with exceptional abilities in analytics, comprehension, and consistency. If this describes you, we are excited to offer you an incredible opportunity to work remotely as a freelancer. Join us in contributing to the creation of data that powers the training of advanced AI models. Role & Responsibilities: Help in the training of an AI assistant model to enhan...

Annotate and evaluate AI-generated Geometry content. Design prompts and assess AI responses for clarity, relevance, and mathematical accuracy in Geometry concepts. Ensure accurate and student-friendly explanations of topics like angles, shapes, surface area, volume, and geometric proofs. Provide feedback to enhance the AI's instructional quality and improve the learning experience. Collaborate with AI teams to integrate best practices from Geometry education into AI-driven solutions. Required Qualifications: Bachelor's degree in Mathematics, Education, or a related field. Strong knowledge of Geometry. Excellent communication skills with a passion for teaching. Prior experience in tutoring or...

Evaluate and improve AI-generated Mathematics content, ensuring it aligns with all rules and formulas. Debug and correct errors in AI-driven Mathematics reasoning and outputs. Collaborate with the AI team to enhance the AI's understanding of Mathematics. Develop and refine practice problems, solutions, and explanations tailored to the JEE Advanced syllabus. Ensure clarity, accuracy, and logical consistency in all teaching materials related to Mathematics. Collaborate with the AI team to enhance the AI's understanding of Mathematics concepts and problem-solving techniques. Create detailed, step-by-step explanations for challenging Mathematics concepts and problems. Stay updated with the lates...

Key Responsibilities: Analyze and refine AI-generated chemical process models. Ensure accuracy in chemical formulations and reactions. Work on AI training datasets for industrial chemistry applications. Must Required Traits: Strong academic background in Chemical Engineering (BSc preferred). Teaching, tutoring, or content creation experience in the field is a plus. Familiarity with AI, machine learning, or data annotation is beneficial. Strong analytical skills and attention to detail.

Annotate and review AI-generated Biology content aligned with K10 curriculum standards. Ensure accurate and age-appropriate explanations of topics like cell structure, genetics, and human anatomy. Design prompts and evaluate AI responses for clarity, engagement, and educational value. Provide feedback to enhance the AI's instructional quality and scientific accuracy. Collaborate with AI teams to integrate best practices from K10 Biology education. Required Qualifications: Bachelor's or Master's degree in Biology, Education, or a related field. Strong understanding of K10 Biology curriculum and key concepts. Experience in content creation or teaching Biology at the K10 level is preferred. Fam...

Evaluate and improve AI-generated Mathematics content, ensuring it aligns with all rules and formulas. Debug and correct errors in AI-driven Mathematics reasoning and outputs. Collaborate with the AI team to enhance the AI's understanding of Mathematics. Develop and refine practice problems, solutions, and explanations tailored to the JEE Advanced syllabus. Ensure clarity, accuracy, and logical consistency in all teaching materials related to Mathematics. Collaborate with the AI team to enhance the AI's understanding of Mathematics concepts and problem-solving techniques. Create detailed, step-by-step explanations for challenging Mathematics concepts and problems. Stay updated with the lates...

Key Responsibilities: Review and annotate AI-generated structural and civil engineering solutions. Assess blueprints and construction-related AI outputs. Ensure AI models generate accurate and logical engineering designs. Must Required Traits: Strong academic background in Civil Engineering (MSc preferred). Teaching, tutoring, or content creation experience in the field is a plus. Familiarity with AI, machine learning, or data annotation is beneficial. Strong analytical skills and attention to detail.

Key Responsibilities: Annotate and evaluate AI-generated Chemistry content aligned with K12 curriculum standards. Ensure accurate and accessible explanations of topics like organic chemistry, stoichiometry, and thermodynamics. Design prompts and assess AI responses for clarity, depth, and educational value. Provide feedback to enhance the AI's scientific accuracy and teaching style. Collaborate with AI teams to reflect best practices in K12 Chemistry education. Required Qualifications: PhD in Chemistry, Education, or a related field. Strong knowledge of Chemistry. Experience in content creation or teaching Chemistry is a plus. Familiarity with online teaching tools and educational platforms.

Key Responsibilities: Evaluate AI-generated electrical circuit designs. Work on AI annotation for power distribution and energy systems. Assess AI's accuracy in electrical load analysis. Must Required Traits: Strong academic background in Electrical Engineering (BSc preferred). Teaching, tutoring, or content creation experience in the field is a plus. Familiarity with AI, machine learning, or data annotation is beneficial. Strong analytical skills and attention to detail.

Key Responsibilities: Develop, review, and refine complex physics problems, solutions, and explanations for AI training Ensure accuracy, clarity, and logical consistency in physics-related data Evaluate and improve AI-generated physics content to ensure alignment with real-world principles Debug and correct errors in AI-driven physics reasoning and outputs Collaborate with AI teams to enhance understanding of mechanics, thermodynamics, electromagnetism, and quantum physics Create detailed explanations and step-by-step solutions for advanced physics problems Required Qualifications: 1st or 2nd-year student at a top IIT with a strong JEE Advanced score Strong grasp of JEE Advanced concepts Min...

Develop, review, and refine mathematical problems, solutions, and explanations for AI training. Ensure accuracy, clarity, and logical consistency in mathematical data. Evaluate and improve AI-generated mathematical content. Debug and correct errors in AI-driven mathematical reasoning. Collaborate with teams to enhance AI's understanding of mathematical concepts. Required Qualifications: MSc in Mathematics. Strong problem-solving and analytical skills. Proficiency in advanced mathematics such as Algebra, Calculus, Probability, and Statistics is a plus.

Key Responsibilities: Develop, review, and refine complex physics problems, solutions, and explanations for AI training Ensure accuracy, clarity, and logical consistency in physics-related data Evaluate and improve AI-generated physics content to ensure alignment with real-world principles Debug and correct errors in AI-driven physics reasoning and outputs Collaborate with AI teams to enhance understanding of mechanics, thermodynamics, electromagnetism, and quantum physics Create detailed explanations and step-by-step solutions for advanced physics problems Required Qualifications: 1st or 2nd-year student at a top IIT with a strong JEE Advanced score Strong grasp of JEE Advanced concepts Min...

Key Responsibilities: Annotate and evaluate AI-generated Philosophy content aligned with K12 curriculum standards. Ensure accurate and accessible explanations of topics like ethics, logic, and major philosophical thinkers. Design prompts and assess AI responses for clarity, conceptual accuracy, and engagement. Provide feedback to improve AI's instructional quality. Required Qualifications: Bachelors or Masters degree in Philosophy or a related field. Strong knowledge of K12 Philosophy curriculum. Ability to present philosophical concepts in a clear and understandable manner. Experience in content creation or teaching Philosophy at the K12 level is preferred. Familiarity with online teaching ...

Help in the training of an AI assistant model to enhance its accuracy and performance. Evaluate the model's responses across multiple dimensions to ensure quality and relevance. Maintain high standards of speed and precision while assessing the model's responses. Must Required Traits: Strong attention to detail. Ability to carefully follow instructions. Excellent proficiency in English.