600 Evaluator Jobs

Competition-Level Math Evaluator – India Hourly Contract | Remote India | $20–$35 per hour 1. Role Overview Mercor is seeking PhD holders, doctoral candidates, and exceptional Master's graduates in Mathematics or related fields to join a high-impact AI research initiative in collaboration with a leading global AI lab. In this role, you will apply your advanced mathematical expertise to evaluate and refine large language models (LLMs) , ensuring they demonstrate precision, logical depth, and rigor in solving both graduate-level mathematics and Olympiad-style competition problems . This position offers the opportunity to contribute to cutting-edge AI research while working remotely and flexibl...

This role is for one of our clients We are seeking highly qualified mathematicians to join a pioneering AI research initiative in partnership with a leading artificial intelligence lab. As a Mathematical Reasoning Evaluator , you’ll leverage your deep understanding of mathematics to assess, refine, and enhance the reasoning accuracy of AI systems tackling complex quantitative and theoretical problems. This opportunity is ideal for PhD scholars, postdoctoral researchers, or advanced Master’s graduates who are passionate about applying their analytical expertise to advance the capabilities of next-generation AI models. Focus Areas We’re looking for experts across a range of mathematical and ap...

This role is for one of our clients We are seeking accomplished physicists and engineers to contribute to a cutting-edge AI research program in collaboration with a leading artificial intelligence lab. As a Scientific Content Evaluator – Physics , you will play a vital role in ensuring the scientific precision, conceptual accuracy, and analytical depth of AI-generated content across diverse areas of physics and applied engineering. This position is ideal for PhD scholars, postdoctoral researchers, or advanced master’s graduates eager to apply their scientific acumen in a frontier field at the intersection of AI and physical sciences . Key Focus Areas We are particularly interested in experti...

This role is for one of our clients We are inviting passionate scientists with advanced expertise in chemistry and related disciplines to contribute to a pioneering AI research program in partnership with a global artificial intelligence lab. As a Scientific Content Evaluator – Chemistry , you will leverage your academic and analytical background to assess, refine, and validate AI-generated scientific content, ensuring that it meets the highest standards of accuracy and rigor. This role is ideal for PhD scholars, postdoctoral researchers, and accomplished master’s graduates who wish to apply their subject-matter expertise in a cutting-edge intersection of chemistry and artificial intelligenc...

Job description: Evaluate used cars with each technical parameter appropriately. To Evaluate vehicles as per the company SOP & upload on Okshan online portal. Conduct thorough inspections of pre-owned vehicles to assess their condition, including exterior, interior, engine, and mechanical components etc. Perform test drives to evaluate the problems of used cars. To check documentation of car like RC, Insurance & Pollution etc. To cross check vehicle challan, NOCs & other documents etc. Research market trends and pricing data to determine the fair market value of used vehicles. Stay informed about industry developments, new technologies, and best practices related to used car evaluation. Plan...

A leading Artificial Intelligence Lab is seeking PhD holders, doctoral candidates, and exceptional Master’s graduates in Physics and related disciplines to join a high-impact AI research initiative advancing the frontiers of scientific understanding. 🔬 Key Domains If you have expertise in one or more of the following areas, we’d love to have you on board: Fundamental Physics: Theoretical Mechanics, Theoretical Optics, Statistical Mechanics, Thermodynamics, Fluid Physics, Optics, and Acoustics Modern & Applied Physics: Electromagnetism and Photonics, Atomic and Molecular Physics, Solid State Physics, Semiconductor Physics, Biophysics Space & Cosmology: Astrophysics, Cosmology Engineering Disc...

Job description: A Mystery Shopper acts as a covert quality evaluator who visits a retail store to assess the customer service, store presentation, staff behavior, product availability, and overall shopping experience, from the perspective of a regular customer. Their role helps the company measure service standards and ensure compliance with brand guidelines. Key Responsibilities Evaluate Customer Service Interact with sales associates and staff as a normal customer. Assess politeness, product knowledge, responsiveness, and helpfulness of employees. Measure waiting times at checkout or service counters. Assess Store Cleanliness and Presentation Check the cleanliness of store premises, fitti...

Company Introduction Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Role Overview Position: Audio Data Evaluator – Contract, Remote Commitment: Flexible hours Join a cutting-edge AI research initiative. Support the development of next-generation models across visual and auditory domains. Responsibilities Evaluate a series of videos and determine preferences. Record short audio clips (2-3 minutes) using provided tools, ensuring high quality and clarity. Ensure recordings are free from background noise or distor...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Specialist Type: Contractor Compensation: $50–$60/hour Location: Remote Commitment: 30 hours/week Role Responsibilities Evaluate the scientific accuracy, reasoning, and technical rigor of LLM-generated content across chemical disciplines. Review outputs on topics spanning molecular structure, kinetics, thermodynamics, catalysis, reaction mechanisms, and industrial processes. Identify and document factual inaccuracies, logical in...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $20–$30/hour Location: Remote Commitment: 30–40 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, id...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $50–$60/hour Location: Remote Commitment: 30 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, ident...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Specialist Type: Contractor Compensation: $50–$60/hour Location: Remote Commitment: 30 hours/week Role Responsibilities Evaluate the scientific accuracy, reasoning, and technical rigor of LLM-generated content across chemical disciplines. Review outputs on topics spanning molecular structure, kinetics, thermodynamics, catalysis, reaction mechanisms, and industrial processes. Identify and document factual inaccuracies, logical in...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $20–$30/hour Location: Remote Commitment: 30–40 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, id...

Company Introduction Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Role Overview Position: Audio Data Evaluator – Contract, Remote Commitment: Flexible hours Join a cutting-edge AI research initiative. Support the development of next-generation models across visual and auditory domains. Responsibilities Evaluate a series of videos and determine preferences. Record short audio clips (2-3 minutes) using provided tools, ensuring high quality and clarity. Ensure recordings are free from background noise or distor...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $50–$60/hour Location: Remote Commitment: 30 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, ident...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $50–$60/hour Location: Remote Commitment: 30 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, ident...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $50–$60/hour Location: Remote Commitment: 30 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, ident...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $50–$60/hour Location: Remote Commitment: 30 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, ident...

Company Introduction Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Role Overview Position: Audio Data Evaluator – Contract, Remote Commitment: Flexible hours Join a cutting-edge AI research initiative. Support the development of next-generation models across visual and auditory domains. Responsibilities Evaluate a series of videos and determine preferences. Record short audio clips (2-3 minutes) using provided tools, ensuring high quality and clarity. Ensure recordings are free from background noise or distor...

For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country. At Peroptyx, we are looking for Data Analysts who will review mapping data for digital mapping applications. Your research capabilities will validate and ensure that the navigation of certain routes are accurate and safe. As part of this role you will verify that business names and opening hours are correct. You will check that the distance from a starting point to an end destination is listed accurately resulting in better user experiences. With this job you can plan your days around this ...

For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country. At Peroptyx, we are looking for Data Analysts who will review mapping data for digital mapping applications. Your research capabilities will validate and ensure that the navigation of certain routes are accurate and safe. As part of this role you will verify that business names and opening hours are correct. You will check that the distance from a starting point to an end destination is listed accurately resulting in better user experiences. With this job you can plan your days around this ...

For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country. At Peroptyx, we are looking for Data Analysts in India who will review mapping data for digital mapping applications. Your research capabilities will validate and ensure that the navigation of certain routes are accurate and safe. As part of this role, you will verify that business names and opening hours are correct. You will check that the distance from a starting point to an end destination is listed accurately, resulting in better user experiences. With this job you can plan your days a...

Company Description LinkedIn is the world’s largest professional network, built to create economic opportunity for every member of the global workforce. Our products help people make powerful connections, discover exciting opportunities, build necessary skills, and gain valuable insights every day. We’re also committed to providing transformational opportunities for our own employees by investing in their growth. We aspire to create a culture that’s built on trust, care, inclusion, and fun – where everyone can succeed. Join us to transform the way the world works. Job Description At LinkedIn, our approach to flexible work is centered on trust and optimized for culture, connection, clarity, a...

Endeavor Academy is a leading EdTech organization specializing in academic content development, AI-based learning evaluation, and expert-led research validation. We collaborate with highly qualified subject matter experts to ensure accuracy, depth, and real-world relevance in AI-generated educational content. Role Overview We are seeking PhD-qualified Sociology experts to join our AI Evaluation Team . The evaluator will critically assess, refine, and validate AI-generated academic responses related to sociology, ensuring that all outputs meet scholarly accuracy, ethical standards, and conceptual depth. Key Responsibilities Evaluate AI-generated content in Sociology for factual accuracy, conc...

Job Title: Car Evaluator Eligibility: - Minimum 4 years of experience as a Technician in OEM - Must have a driving license and know how to drive both 2-wheelers and 4-wheelers Job Description: - Evaluate and identify issues in vehicles - Visit customers' locations to inspect cars - Click and upload images of car parts on the app - Ensure proper submission of reports on the app - Estimate repair costs - Strong knowledge of vehicle components (chassis, panels, paint, engine, clutch, gearbox, brakes, suspension, etc.) - Ability to read and understand basic English Contact Information: - Interested candidates can DM (direct message) or share their resume - WhatsApp also available at 9315987720