633 Rubrics Jobs - Page 6

Purpose We are seeking a highly experienced Audio professional consultant to serve as a consultant on AI training data projects for leading AI model builders and enterprises. Your focus will be to define success criteria, review outputs, and provide targeted guidance to improve quality and speed — directly contributing to the successful delivery of domain-specific annotated datasets that meet the highest technical standards. You will be engaged on specific projects with clearly defined deliverables, milestones, and end dates. Components Technical Standard Setting, Quality Control, and Process Improvement Define domain-specific quality success metrics (e.g., 48 kHz sample rate, 24-bit depth, ...

Purpose We are seeking a highly experienced Litigation lawyer consultant to serve as a consultant on AI training data projects for leading AI model builders and enterprises. Your focus will be to define success criteria, review outputs, and provide targeted guidance to improve quality and speed — directly contributing to the successful delivery of domain-specific annotated datasets that meet the highest technical standards. You will be engaged on specific projects with clearly defined deliverables, milestones, and end dates. Components Technical Standard Setting, Quality Control, and Process Improvement Define domain-specific quality success metrics. Develop project-specific SOPs, QA rubrics...

Do you enjoy Kaggle-style problem solving, iterating on models, testing ideas, and driving performance gains? Now imagine doing that as paid work, where your solutions directly strengthen the world’s most advanced AI systems. Large-scale language models are evolving into engines of discovery, education, and engineering. To get there, they need sharper reasoning and better datasets. As a Machine Learning Specialist, you will take on hands-on ML challenges that feel like research competitions, but with direct impact on next-generation AI. What You’ll Do On a typical day, you will: Solve applied ML tasks: iterating on problems that test and improve model reasoning, from baseline solutions to op...

Purpose We are seeking a highly experienced Linguistics professional consultant to serve as a consultant on AI training data projects for leading AI model builders and enterprises. Your focus will be to define success criteria, review outputs, and provide targeted guidance to improve quality and speed — directly contributing to the successful delivery of domain-specific annotated datasets that meet the highest technical standards. You will be engaged on specific projects with clearly defined deliverables, milestones, and end dates. Components Technical Standard Setting, Quality Control, and Process Improvement Define domain-specific quality success metrics (e.g., accuracy of transcription, c...

Published 2025-10-13 About Quest Alliance: Quest Alliance is a not-for-profit organization working across India, dedicated to equipping young people with the skills they need to thrive in a rapidly evolving world of work. Since 2008, we’ve been reimagining how young learners, especially those from underserved communities experience education, career readiness, and lifelong learning. We have been enabling equitable school-to-work transitions by building future-ready learning ecosystems that prioritize access, inclusion, and innovation. Through strong collaboration with government systems, educators, communities, and civil society, we co-create tech-enabled learning experiences that empower yo...

Published 2025-10-13 About Quest Alliance: Quest Alliance is a not-for-profit organization working across India, dedicated to equipping young people with the skills they need to thrive in a rapidly evolving world of work. Since 2008, we’ve been reimagining how young learners, especially those from underserved communities experience education, career readiness, and lifelong learning. We have been enabling equitable school-to-work transitions by building future-ready learning ecosystems that prioritize access, inclusion, and innovation. Through strong collaboration with government systems, educators, communities, and civil society, we co-create tech-enabled learning experiences that empower yo...

🚀 Project Manager – AI Agentic Workflow (Remote, Short-Term) | Taskify Taskify is seeking skilled Project Managers for a pioneering AI research initiative focused on building agentic workflows — structured processes that capture how experts truly think, reason, and solve complex problems. Be part of a project shaping next-generation AI systems by transforming professional expertise into actionable workflows. Key Responsibilities Translate domain knowledge into clear, structured instructions (SOPs, rubrics, evaluation criteria) designed for AI consumption. Design realistic tasks and scenarios that reflect authentic daily work in Project Management. Collaborate with fellow experts to refine an...

STEM Raters for GenAI Data Role Overview As a STEM Rater for [Maths/Physics/Chemistry/Biology/Coding/Finance], you will be a crucial contributor to shaping the "brain" of our AI. Working closely with the STEM Lead and your team, your primary responsibility will be to meticulously create, review, and refine high-quality data. This involves evaluating AI responses for accuracy, clarity, and pedagogical effectiveness, ensuring they are insightful, well-structured, and tailored to the learner's level. You will apply your deep subject matter expertise to provide critical feedback that directly enhances the AI's ability to teach millions at scale through technology. Profile of the Ideal Candidate ...

What You’ll Do As a full-time Devrel, you will: Leverage your deep technical knowledge across AI, Cloud, and Software Development to evaluate a wide variety of innovative prototypes and solutions. Assess technical feasibility, architecture, scalability, performance, and security aspects of submitted ideas or working solutions. Provide clear, actionable feedback to teams and participants to refine their solutions. Contribute to the creation of evaluation rubrics and scoring frameworks. Stay on top of emerging technologies, frameworks, and tools in AI, LLMs, agentic systems, cloud-native apps, DevOps, and software engineering. Collaborate cross-functionally with program managers, evaluators, a...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please provide your resume in English and specify your proficiency level. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What We Do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About The Role GenAI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and ...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please provide your resume in English and specify your proficiency level. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What We Do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About The Role GenAI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and ...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please provide your resume in English and specify your proficiency level. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What We Do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About The Role GenAI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and ...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please provide your resume in English and specify your proficiency level. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What We Do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About The Role GenAI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and ...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please provide your resume in English and specify your proficiency level. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What We Do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About The Role GenAI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and ...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please provide your resume in English and specify your proficiency level. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What We Do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About The Role GenAI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and ...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please provide your resume in English and specify your proficiency level. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What We Do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About The Role GenAI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and ...

This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please provide your resume in English and specify your proficiency level. At Mindrift, innovation meets opportunity. We believe in using the power of collective intelligence to ethically shape the future of AI. What We Do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About The Role GenAI models are improving very quickly, and one of our goals is to make them capable of addressing specialized questions and ...

Company Introduction Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Role Overview Position: STEM Expert – Contract, Remote Commitment: 20 hours per week, Duration: 1 month Develop and refine high-quality reasoning questions to evaluate AI models. Ensure accuracy and instructional quality in biology, physics, and chemistry. Responsibilities Design and Optimize STEM-Based Prompts: Create detailed prompts with multiple constraints and scientific instructions. Define and Document Evaluation Standards: Establish hi...

Company Introduction Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Role Overview Position: STEM Expert – Contract, Remote Commitment: 20 hours per week, Duration: 1 month Develop and refine high-quality reasoning questions to evaluate AI models. Ensure accuracy and instructional quality in biology, physics, and chemistry. Responsibilities Design and Optimize STEM-Based Prompts: Create detailed prompts with multiple constraints and scientific instructions. Define and Document Evaluation Standards: Establish hi...

Company Introduction Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Role Overview Position: STEM Expert – Contract, Remote Commitment: 20 hours per week, Duration: 1 month Develop and refine high-quality reasoning questions to evaluate AI models. Ensure accuracy and instructional quality in biology, physics, and chemistry. Responsibilities Design and Optimize STEM-Based Prompts: Create detailed prompts with multiple constraints and scientific instructions. Define and Document Evaluation Standards: Establish hi...

Company Introduction Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Role Overview Position: STEM Expert – Contract, Remote Commitment: 20 hours per week, Duration: 1 month Develop and refine high-quality reasoning questions to evaluate AI models. Ensure accuracy and instructional quality in biology, physics, and chemistry. Responsibilities Design and Optimize STEM-Based Prompts: Create detailed prompts with multiple constraints and scientific instructions. Define and Document Evaluation Standards: Establish hi...

Company Introduction Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Role Overview Position: STEM Expert – Contract, Remote Commitment: 20 hours per week, Duration: 1 month Develop and refine high-quality reasoning questions to evaluate AI models. Ensure accuracy and instructional quality in biology, physics, and chemistry. Responsibilities Design and Optimize STEM-Based Prompts: Create detailed prompts with multiple constraints and scientific instructions. Define and Document Evaluation Standards: Establish hi...

Company Introduction Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Role Overview Position: STEM Expert – Contract, Remote Commitment: 20 hours per week, Duration: 1 month Develop and refine high-quality reasoning questions to evaluate AI models. Ensure accuracy and instructional quality in biology, physics, and chemistry. Responsibilities Design and Optimize STEM-Based Prompts: Create detailed prompts with multiple constraints and scientific instructions. Define and Document Evaluation Standards: Establish hi...

Company Introduction Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Role Overview Position: STEM Expert – Contract, Remote Commitment: 20 hours per week, Duration: 1 month Develop and refine high-quality reasoning questions to evaluate AI models. Ensure accuracy and instructional quality in biology, physics, and chemistry. Responsibilities Design and Optimize STEM-Based Prompts: Create detailed prompts with multiple constraints and scientific instructions. Define and Document Evaluation Standards: Establish hi...

Location: Ahmedabad, India Experience: 4+ Years Department: Operations | Quality Assurance | Technical Evaluation Employment Type: Full-Time About the Role We are seeking a Technical Evaluator – Programming & Tech to assess, validate, and maintain the quality of freelance professionals across a wide range of technology categories. This role focuses on vetting applications from skilled freelancers, ensuring they meet professional standards before onboarding, and monitoring their ongoing performance for quality consistency. You will be responsible for evaluating technical expertise, reviewing submitted projects and portfolios, and making data-driven decisions regarding approval, promotion, or ...