Instructional Designer

Company Introduction

Mercor

Benchmark

General Catalyst

Peter Thiel

Adam D'Angelo

Larry Summers

Jack Dorsey

Role Overview

• Position: Writing Expert – Freelance, Remote
• Commitment: 20 hours per week, Duration: 1 month
• Contribute to a high-impact audio AI research project. Author prompt–golden answer pairs for training and evaluating language models.
  

Responsibilities

• Design and Optimize Prompts: Create detailed audio prompts with multiple constraints and instructions.
• Define and Document Evaluation Standards: Establish high-level expectations for correct responses in general audio consumer contexts, and develop comprehensive rubric.
• Conduct Model Testing and Grading: Run prompts through models and assess preliminary outputs against expectations.
• Support Benchmarking and Quality Assurance: Collaborate in QA review processes to ensure prompt tasks and rubrics meet rigor, maintaining consistency and reliability before integration into official benchmarks.
  

Requirements / Qualifications

Must-Have Qualifications

• BS or BA from a reputable institution completed or in progress
• Strong writing and critical thinking skills
• Ability to work independently and meet deadlines
• Significant familiarity with ChatGPT or similar tools for personal decision-making or hobbies / general interests
  

Preferred Qualifications

• 2+ years of experience in teaching or research
  

Engagement Details

• Remote and asynchronous role
• 20 hours per week commitment
• Duration: 1 month
  

Application Process (Takes 20-30 mins to complete)

• Complete an AI-led interview, this should take around 15 minutes
• Complete a 45-minute written assessment that will guide you through writing rubrics
• If selected, you will be invited to work on the project
  

Resources & Support

• For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
• For any help or support, reach out to: support@mercor.com