Data Scientist | $30/hr Remote | Mercor

At Crossing Hurdles, we work as a referral partner. We refer candidates to Mercor that collaborates with the world’s leading AI research labs to build and train cutting-edge AI models.

Organization:

Position:

Referral Partner:

Type:

Compensation:

Location:

Commitment:

Role Responsibilities (Training support will be provided)

• Review and validate reinforcement learning (RL) environment design, terminal conditions, and benchmarking protocols.
• Assess evaluation metrics and ensure fairness, reproducibility, and consistency across RL experiments.
• Provide detailed technical feedback on environment codebases, documentation, and evaluation workflows.
• Collaborate with AI researchers to refine environment architecture, performance measures, and reproducibility standards.
• Verify experimental results across runs, seeds, and hardware configurations to ensure robust benchmarking practices.
• Recommend improvements for environment design, metric definitions, and implementation rigor.

Requirements

• Strong background in Reinforcement Learning, Computer Science, or Applied AI research.
• Experience working with RL environments and benchmarking methodologies.
• Skilled in Python programming; familiarity with frameworks such as PyTorch or TensorFlow preferred.
• Excellent understanding of evaluation metrics, reproducibility protocols, and experimental analysis.
• Strong analytical thinking, technical communication, and attention to detail.
• Interest in agentic AI systems and the development of reliable evaluation pipelines.

Application Process (Takes 20 min)

1. Upload resume
2. AI interview based on your resume (15 min)
3. Submit form