963 Evaluator Jobs - Page 8

For thousands of years, maps have provided humans with the knowledge they need to make decisions. As a Maps Evaluator, you will have the opportunity to provide ground truth for your town, city or country. At Peroptyx, we are looking for Data Analysts in India who will review mapping data for digital mapping applications. Your research capabilities will validate and ensure that the navigation of certain routes are accurate and safe. As part of this role, you will verify that business names and opening hours are correct. You will check that the distance from a starting point to an end destination is listed accurately, resulting in better user experiences. With this job you can plan your days a...

Additional Information Job Number 25192404 Job Category Property Leadership Location Courtyard by Marriott Shillong, Jail Road, Police Bazar, Shillong, Meghalaya, India, 793001 Schedule Full Time Located Remotely? N Position Type Management JOB SUMMARY Functions as the primary strategic business leader of the property with responsibility for all aspects of the operation, including: managing general property performance, managing and sustaining sales and marketing strategy, managing profitability, managing revenue generation, and delivering a return on investment to both Marriott International and ownership. Leads the team in the development and implementation of property-wide strategies. Act...

Car Evaluator

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $20–$30/hour Location: Remote Commitment: 30–40 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, id...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Coding Assistant Evaluator Type: Contract Compensation: $40–$85/hour Location: Remote Commitment: Flexible, task-based Role Responsibilities Review long-form transcripts between users and AI coding assistants. Analyze the AI's logic, execution, and stated actions in detail. Score each transcript using a 10-point rubric across multiple criteria. Optionally write brief justifications citing examples from the dialogue. Detect mismatches bet...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Coding Assistant Evaluator Type: Contract Compensation: $40–$85/hour Location: Remote Commitment: Flexible, task-based Role Responsibilities Review long-form transcripts between users and AI coding assistants. Analyze the AI's logic, execution, and stated actions in detail. Score each transcript using a 10-point rubric across multiple criteria. Optionally write brief justifications citing examples from the dialogue. Detect mismatches bet...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $20–$30/hour Location: Remote Commitment: 30–40 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, id...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Coding Assistant Evaluator Type: Contract Compensation: $40–$85/hour Location: Remote Commitment: Flexible, task-based Role Responsibilities Review long-form transcripts between users and AI coding assistants. Analyze the AI's logic, execution, and stated actions in detail. Score each transcript using a 10-point rubric across multiple criteria. Optionally write brief justifications citing examples from the dialogue. Detect mismatches bet...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $50–$60/hour Location: Remote Commitment: 30 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, ident...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $50–$60/hour Location: Remote Commitment: 30 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, ident...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $50–$60/hour Location: Remote Commitment: 30 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, ident...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $50–$60/hour Location: Remote Commitment: 30 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, ident...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $50–$60/hour Location: Remote Commitment: 30 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, ident...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $50–$60/hour Location: Remote Commitment: 30 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, ident...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Sports Content Evaluator Type: Contract Compensation: $45–$70/hour Location: Remote Role Responsibilities Evaluate and score AI-generated commentary, reports, and tactical analyses across multiple sports. Assess the depth of sports knowledge, player understanding, and situational awareness in AI outputs. Identify factual inaccuracies, tactical misinterpretations, or tone/style mismatches in AI analyses. Evaluate how AI performance varies ac...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $20–$30/hour Location: Remote Commitment: 30–40 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, id...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Coding Assistant Evaluator Type: Contract Compensation: $40–$85/hour Location: Remote Commitment: Flexible, task-based Role Responsibilities Review long-form transcripts between users and AI coding assistants. Analyze the AI's logic, execution, and stated actions in detail. Score each transcript using a 10-point rubric across multiple criteria. Optionally write brief justifications citing examples from the dialogue. Detect mismatches bet...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Preference Ranking Model Evaluator Type: Freelance Compensation: $25–$35/hour Location: Remote Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses based on quality, coherence, and helpfulness. Assign preference rankings to pairs or sets of model outputs. Follow detailed labeling guidelines and adjust based on evolving criteria. Provide brief written explanations for ranking decisions when required....

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Preference Ranking Model Evaluator Type: Freelance Compensation: $25–$35/hour Location: Remote Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses based on quality, coherence, and helpfulness. Assign preference rankings to pairs or sets of model outputs. Follow detailed labeling guidelines and adjust based on evolving criteria. Provide brief written explanations for ranking decisions when required....

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Coding Assistant Evaluator Type: Contract Compensation: $40–$85/hour Location: Remote Commitment: Flexible, task-based Role Responsibilities Review long-form transcripts between users and AI coding assistants. Analyze the AI's logic, execution, and stated actions in detail. Score each transcript using a 10-point rubric across multiple criteria. Optionally write brief justifications citing examples from the dialogue. Detect mismatches bet...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Sports Content Evaluator Type: Contract Compensation: $45–$70/hour Location: Remote Role Responsibilities Evaluate and score AI-generated commentary, reports, and tactical analyses across multiple sports. Assess the depth of sports knowledge, player understanding, and situational awareness in AI outputs. Identify factual inaccuracies, tactical misinterpretations, or tone/style mismatches in AI analyses. Evaluate how AI performance varies ac...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Coding Assistant Evaluator Type: Contract Compensation: $40–$85/hour Location: Remote Commitment: Flexible, task-based Role Responsibilities Review long-form transcripts between users and AI coding assistants. Analyze the AI's logic, execution, and stated actions in detail. Score each transcript using a 10-point rubric across multiple criteria. Optionally write brief justifications citing examples from the dialogue. Detect mismatches bet...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Preference Ranking Model Evaluator Type: Freelance Compensation: $25–$35/hour Location: Remote Commitment: 10–20 hours/week Role Responsibilities Evaluate and compare AI-generated responses based on quality, coherence, and helpfulness. Assign preference rankings to pairs or sets of model outputs. Follow detailed labeling guidelines and adjust based on evolving criteria. Provide brief written explanations for ranking decisions when required....

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Sports Content Evaluator Type: Contract Compensation: $45–$70/hour Location: Remote Role Responsibilities Evaluate and score AI-generated commentary, reports, and tactical analyses across multiple sports. Assess the depth of sports knowledge, player understanding, and situational awareness in AI outputs. Identify factual inaccuracies, tactical misinterpretations, or tone/style mismatches in AI analyses. Evaluate how AI performance varies ac...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: Sports Content Evaluator Type: Contract Compensation: $45–$70/hour Location: Remote Role Responsibilities Evaluate and score AI-generated commentary, reports, and tactical analyses across multiple sports. Assess the depth of sports knowledge, player understanding, and situational awareness in AI outputs. Identify factual inaccuracies, tactical misinterpretations, or tone/style mismatches in AI analyses. Evaluate how AI performance varies ac...