927 Evaluator Jobs - Page 3

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Sports Content Evaluator Type: Contract Compensation: $45–$70/hour Location: Remote Role Responsibilities Evaluate and score AI-generated commentary, reports, and tactical analyses across multiple sports. Assess the depth of sports knowledge, player understanding, and situational awareness in AI outputs. Identify factual inaccuracies, tactical misinterpretations, or tone/style mismatches in AI analyses. Evaluate how AI performance varies ac...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Preference Ranking Model Evaluator Type: Freelance Compensation: $25–$35/hour Location: Remote Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses based on quality, coherence, and helpfulness. Assign preference rankings to pairs or sets of model outputs. Follow detailed labeling guidelines and adjust based on evolving criteria. Provide brief written explanations for ranking decisions when required....

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Preference Ranking Model Evaluator Type: Freelance Compensation: $25–$35/hour Location: Remote Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses based on quality, coherence, and helpfulness. Assign preference rankings to pairs or sets of model outputs. Follow detailed labeling guidelines and adjust based on evolving criteria. Provide brief written explanations for ranking decisions when required....

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Sports Content Evaluator Type: Contract Compensation: $45–$70/hour Location: Remote Role Responsibilities Evaluate and score AI-generated commentary, reports, and tactical analyses across multiple sports. Assess the depth of sports knowledge, player understanding, and situational awareness in AI outputs. Identify factual inaccuracies, tactical misinterpretations, or tone/style mismatches in AI analyses. Evaluate how AI performance varies ac...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Sports Content Evaluator Type: Contract Compensation: $45–$70/hour Location: Remote Role Responsibilities Evaluate and score AI-generated commentary, reports, and tactical analyses across multiple sports. Assess the depth of sports knowledge, player understanding, and situational awareness in AI outputs. Identify factual inaccuracies, tactical misinterpretations, or tone/style mismatches in AI analyses. Evaluate how AI performance varies ac...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Preference Ranking Model Evaluator Type: Freelance Compensation: $25–$35/hour Location: Remote Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses based on quality, coherence, and helpfulness. Assign preference rankings to pairs or sets of model outputs. Follow detailed labeling guidelines and adjust based on evolving criteria. Provide brief written explanations for ranking decisions when required....

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Sports Content Evaluator Type: Contract Compensation: $45–$70/hour Location: Remote Role Responsibilities Evaluate and score AI-generated commentary, reports, and tactical analyses across multiple sports. Assess the depth of sports knowledge, player understanding, and situational awareness in AI outputs. Identify factual inaccuracies, tactical misinterpretations, or tone/style mismatches in AI analyses. Evaluate how AI performance varies ac...

Work Mode: Remote Engagement: Freelance / Flexible Hours Overview We are seeking skilled AI Content Evaluators with proficiency in one or more Indian languages to assess, review, and compare AI-generated responses. This role involves identifying toxic or harmful content, understanding linguistic nuances, and ensuring high-quality model performance across multiple datasets. If you have strong language skills, cultural awareness, and an eye for detail, this role is an excellent fit. Key Responsibilities Evaluate AI-generated outputs across various Indic languages (both native script and transliterated formats). Identify and flag harmful, toxic, or hate-based content, including subtle context-d...

About Turing Based in San Francisco, California, Turing is the world’s leading research accelerator for frontier AI labs and a trusted partner for global enterprises deploying advanced AI systems. Turing supports customers in two ways: first, by accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in coding, reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises transform AI from proof of concept into proprietary intelligence with systems that perform reliably, deliver measurable impact, and drive lasting results on the P&L Role Overview As a Software Enginee...

Pre own car Sales, Old car evaluation, Customer Care Manager and Enquiry Distribution Portal. Job Types: Full-time, Fresher Pay: ₹15,000.00 - ₹20,000.00 per month Benefits: Health insurance Work Location: In person

Diploma in Mechanical or Automobile. Having DL of CAR. Knows car driving. Freshers can apply. Job Type: Full-time Pay: ₹10,000.00 - ₹15,000.00 per month Benefits: Cell phone reimbursement Health insurance Application Question(s): Do you Know how to driver a car ? License/Certification: Driving Licence (Required) Work Location: On the road

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $50–$60/hour Location: Remote Commitment: 30 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, ident...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $20–$30/hour Location: Remote Commitment: 30–40 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, id...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $50–$60/hour Location: Remote Commitment: 30 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, ident...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $50–$60/hour Location: Remote Commitment: 30 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, ident...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $20–$30/hour Location: Remote Commitment: 30–40 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, id...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $50–$60/hour Location: Remote Commitment: 30 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, ident...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $20–$30/hour Location: Remote Commitment: 30–40 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, id...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $50–$60/hour Location: Remote Commitment: 30 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, ident...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Coding Assistant Evaluator Type: Contract Compensation: $40–$85/hour Location: Remote Commitment: Flexible, task-based Role Responsibilities Review long-form transcripts between users and AI coding assistants. Analyze the AI's logic, execution, and stated actions in detail. Score each transcript using a 10-point rubric across multiple criteria. Optionally write brief justifications citing examples from the dialogue. Detect mismatches bet...

For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country. At Peroptyx, we are looking for Data Analysts who will review mapping data for digital mapping applications. Your research capabilities will validate and ensure that the navigation of certain routes are accurate and safe. As part of this role you will verify that business names and opening hours are correct. You will check that the distance from a starting point to an end destination is listed accurately resulting in better user experiences. With this job you can plan your days around this ...

For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country. At Peroptyx, we are looking for Data Analysts in India who will review mapping data for digital mapping applications. Your research capabilities will validate and ensure that the navigation of certain routes are accurate and safe. As part of this role, you will verify that business names and opening hours are correct. You will check that the distance from a starting point to an end destination is listed accurately, resulting in better user experiences. With this job you can plan your days a...

For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country. At Peroptyx, we are looking for Data Analysts in India who will review mapping data for digital mapping applications. Your research capabilities will validate and ensure that the navigation of certain routes are accurate and safe. As part of this role, you will verify that business names and opening hours are correct. You will check that the distance from a starting point to an end destination is listed accurately, resulting in better user experiences. With this job you can plan your days a...

Conduct thorough evaluations of premium products and services based on predefined criteria. Develop and maintain evaluation protocols and standards to ensure consistent and unbiased assessments. Compile detailed reports summarizing findings, including strengths and weaknesses of the evaluated items. Provide actionable feedback and recommendations for improvements based on evaluation results. Engage with product development teams to communicate findings and facilitate product enhancements. Stay up-to-date with industry trends and best practices related to premium goods to inform evaluation criteria. Collaborate with marketing and sales teams to understand customer expectations and experiences...

Dear All, Greetings from PBOplus !! We are hiring for AI & LLM Engineer – PLOT (ODIF + OSIF) Location: Remote / Delhi NCR Experience: 2–5 years Reporting To: Product Lead, PLOT AI Division Role Overview We are building AI copilots for manufacturing execution through our twin platforms — ODIF (On Day In Full) for human performance and OSIF (One Shift In Full) for process intelligence. You will lead the LLM and AI agent layer — transforming PLOT’s massive structured data (WBS, 3TSOP, production, and compliance datasets) into interactive, queryable AI systems using LangChain and LangGraph frameworks. Key ResponsibilitiesFor ODIF (Human Performance AI) · Build an LLM-based Chat Engine using RAG ...