STEM Expert - Fully Remote

Company Introduction

Mercor

Benchmark

General Catalyst

Peter Thiel

Adam D'Angelo

Larry Summers

Jack Dorsey

Role Overview

• Position: STEM Expert – Contract, Remote
• Commitment: 20 hours per week, Duration: 1 month
• Develop and refine high-quality reasoning questions to evaluate AI models. Ensure accuracy and instructional quality in biology, physics, and chemistry.
  

Responsibilities

• Design and Optimize STEM-Based Prompts: Create detailed prompts with multiple constraints and scientific instructions.
• Define and Document Evaluation Standards: Establish high-level expectations for correct responses in STEM contexts and develop a comprehensive rubric.
• Conduct Model Testing and Grading: Run prompts through models and assess preliminary outputs against expectations.
• Support Benchmarking and Quality Assurance: Collaborate in QA review processes to ensure prompt tasks and rubrics meet scientific rigor, maintaining consistency and reliability before integration into official benchmarks.
  

Requirements / Qualifications

Must-Have Qualifications

• BS or BA in Biology, Physics, or Chemistry
• Familiarity with undergraduate-level biology, physics, chemistry topics
• Strong writing and critical thinking skills
• Ability to work independently and meet deadlines
  

Preferred Qualifications

• 2+ years of experience in teaching, research, or applied STEM discipline field
  

Engagement Details

• Remote and asynchronous role
• 20 hours per week commitment
• Duration: 1 month
• Structured project environment with clear goals and tools
  

Application Process (Takes 20-30 mins to complete)

• Complete an AI-led interview, this should take around 15 minutes
• Complete a 45-minute written assessment that will guide you through writing rubrics
• If selected, you will be invited to work on the project
  

Resources & Support

• For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
• For any help or support, reach out to: support@mercor.com