633 Rubrics Jobs - Page 2

Company Introduction Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Role Overview Position: Data Annotation Specialist – Contract, Remote Commitment: 20 hours per week, through December with potential for extension. Work on improving AI systems by categorizing and labeling data using predefined taxonomies. Responsibilities Synthesize information from large volumes of data. Annotate and categorize text, images, and other data in line with detailed guidelines. Apply predefined rubrics and taxonomies to ensure st...

Company Introduction Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Role Overview Position: Data Annotation Specialist – Contract, Remote Commitment: 20 hours per week, through December with potential for extension. Work on improving AI systems by categorizing and labeling data using predefined taxonomies. Responsibilities Synthesize information from large volumes of data. Annotate and categorize text, images, and other data in line with detailed guidelines. Apply predefined rubrics and taxonomies to ensure st...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $50–$60/hour Location: Remote Commitment: 30 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, ident...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $50–$60/hour Location: Remote Commitment: 30 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, ident...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $50–$60/hour Location: Remote Commitment: 30 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, ident...

About The Job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Research Evaluator Type: Contractor Compensation: $50–$60/hour Location: Remote Commitment: 30 hours/week Role Responsibilities Review and audit submitted data, including prompts, solutions, final answers, references, and metadata. Evaluate task quality using structured turn-level and task-level rubrics, ensuring clarity, correctness, and logical consistency. Verify the accuracy of solutions, reasoning steps, and chain-of-thoughts, ident...

Company Introduction Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Role Overview Position: STEM Expert – Contract, Remote Commitment: 20 hours per week, Duration: 1 month Develop and refine high-quality reasoning questions to evaluate AI models. Ensure accuracy and instructional quality in biology, physics, and chemistry. Responsibilities Design and Optimize STEM-Based Prompts: Create detailed prompts with multiple constraints and scientific instructions. Define and Document Evaluation Standards: Establish hi...

Company Introduction Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Role Overview Position: Data Annotation Specialist – Contract, Remote Commitment: 20 hours per week, through December with potential for extension. Work on improving AI systems by categorizing and labeling data using predefined taxonomies. Responsibilities Synthesize information from large volumes of data. Annotate and categorize text, images, and other data in line with detailed guidelines. Apply predefined rubrics and taxonomies to ensure st...

Company Introduction Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Role Overview Position: Data Annotation Specialist – Contract, Remote Commitment: 20 hours per week, through December with potential for extension. Work on improving AI systems by categorizing and labeling data using predefined taxonomies. Responsibilities Synthesize information from large volumes of data. Annotate and categorize text, images, and other data in line with detailed guidelines. Apply predefined rubrics and taxonomies to ensure st...

Company Introduction Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Role Overview Position: Data Annotation Specialist – Contract, Remote Commitment: 20 hours per week, through December with potential for extension. Work on improving AI systems by categorizing and labeling data using predefined taxonomies. Responsibilities Synthesize information from large volumes of data. Annotate and categorize text, images, and other data in line with detailed guidelines. Apply predefined rubrics and taxonomies to ensure st...

Company Introduction Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Role Overview Position: STEM Expert – Contract, Remote Commitment: 20 hours per week, Duration: 1 month Develop and refine high-quality reasoning questions to evaluate AI models. Ensure accuracy and instructional quality in biology, physics, and chemistry. Responsibilities Design and Optimize STEM-Based Prompts: Create detailed prompts with multiple constraints and scientific instructions. Define and Document Evaluation Standards: Establish hi...

Company Introduction Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Role Overview Position: STEM Expert – Contract, Remote Commitment: 20 hours per week, Duration: 1 month Develop and refine high-quality reasoning questions to evaluate AI models. Ensure accuracy and instructional quality in biology, physics, and chemistry. Responsibilities Design and Optimize STEM-Based Prompts: Create detailed prompts with multiple constraints and scientific instructions. Define and Document Evaluation Standards: Establish hi...

Company Introduction Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Role Overview Position: Data Annotation Specialist – Contract, Remote Commitment: 20 hours per week, through December with potential for extension. Work on improving AI systems by categorizing and labeling data using predefined taxonomies. Responsibilities Synthesize information from large volumes of data. Annotate and categorize text, images, and other data in line with detailed guidelines. Apply predefined rubrics and taxonomies to ensure st...

Company Introduction Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Role Overview Position: Data Annotation Specialist – Contract, Remote Commitment: 20 hours per week, through December with potential for extension. Work on improving AI systems by categorizing and labeling data using predefined taxonomies. Responsibilities Synthesize information from large volumes of data. Annotate and categorize text, images, and other data in line with detailed guidelines. Apply predefined rubrics and taxonomies to ensure st...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What We Do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About The Role Generative AI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questio...

Sr. Quality Analyst Role Objective The Senior Quality Analyst is responsible for ensuring the accuracy, compliance, and quality of order forms and contracts processed under Googles Deal Operations workflows. The role involves performing detailed audits, identifying process gaps, driving root cause analysis (RCA), and collaborating with cross-functional teams to reduce error leakage and enhance first-pass yield. The Senior QA also mentors junior QAs and supports continuous improvement initiatives to maintain best-in-class quality standards. Key Responsibilities Audit & Compliance Perform in-depth QA checks across workflows (Request Validation Form, Order Validation Form, Pre-Booking, and Post...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What We Do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About The Role Generative AI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questio...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What We Do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About The Role Generative AI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questio...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What We Do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About The Role Generative AI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questio...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What We Do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About The Role Generative AI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questio...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What We Do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About The Role Generative AI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questio...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What We Do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About The Role Generative AI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questio...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What We Do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About The Role Generative AI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questio...

Why this role We’re building enterprise‑grade Agentic AI platform & applications for recruitment —from sourcing and screening to interview assistance and offer orchestration. You’ll lead a small, high‑leverage team that ships fast, measures rigorously, and scales responsibly. What you’ll do Own delivery end‑to‑end: backlog, execution, quality, and timelines for Agentic AI features. Be hands‑on (30–50% coding): set the technical bar in Python/TypeScript; review PRs; unblock tricky problems. Design agentic systems: tool‑use orchestration, planning/looping, memory, safety rails, and cost/perf optimization. Leverage LLMs smartly: RAG, structured output, function/tool calling, multi‑model routing...

Sr. Quality Analyst Role Objective The Senior Quality Analyst is responsible for ensuring the accuracy, compliance, and quality of order forms and contracts processed under Googles Deal Operations workflows. The role involves performing detailed audits, identifying process gaps, driving root cause analysis (RCA), and collaborating with cross-functional teams to reduce error leakage and enhance first-pass yield. The Senior QA also mentors junior QAs and supports continuous improvement initiatives to maintain best-in-class quality standards. Key Responsibilities Audit & Compliance Perform in-depth QA checks across workflows (Request Validation Form, Order Validation Form, Pre-Booking, and Post...