Data Scientist - AI/ML Specialist

About The Job

Mercor

Benchmark

General Catalyst

Peter Thiel

Adam D'Angelo

Larry Summers

Jack Dorsey

Position:

Type:

Hourly contractor

Compensation:

$14/hour

Location:

Remote

Commitment:

20–40 hours/week

Role Responsibilities

• Develop data collection and preprocessing pipelines for structured and unstructured data from multiple agent simulations.
• Build and iterate on machine learning models for performance prediction, behavior clustering, and outcome optimization.
• Design and maintain dashboards and visualization tools for monitoring agent performance, benchmarks, and trends.
• Conduct statistical analyses to evaluate the efficacy of AI systems under various environments and constraints.
• Collaborate with engineers to design evaluation frameworks that measure reasoning quality, adaptability, and efficiency.
• Prototype data-driven tools and feedback loops to automatically improve model accuracy and agent behavior over time.
  

Qualifications

Must-Have

• Strong background in data science, machine learning, or applied statistics.
• Proficient in Python, SQL, and familiar with libraries such as Pandas, NumPy, Scikit-learn, and PyTorch/TensorFlow.
• Understanding of probabilistic modeling, statistical inference, and experimentation frameworks (A/B testing, causal inference).
• Experience with large-scale data systems (Snowflake, BigQuery, or similar).
• Ability to collect, clean, and transform complex datasets into structured formats ready for modeling and analysis.
  

Preferred

• Interest in AI agents and how data can shape their reasoning, adaptability, and behavior.
• Enjoy collaborating with cross-functional teams to define meaningful KPIs and experiment setups.
  

Compensation & Legal

• Hourly contractor to Mercor.
• Paid weekly via Stripe Connect, based on hours logged.
• Weekly bonus of $500 - $1000 USD per 5 tasks created.
  

Application Process (Takes 20–30 mins to complete)

• Upload resume
• AI interview based on your resume
• Submit form
  

Resources & Support

• For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome
• For any help or support, reach out to: support@mercor.com