Senior Code Reviewer

Now Hiring: Senior Code Reviewer (Python + Docker) | LLM Data Training

Remote | Contract

Focus: Code Review, AI Evaluation, Python, Docker

Project: Atlas – High-Quality Data for AI

Senior Code Reviewer

About the Role

As a Senior Code Reviewer, you’ll review evaluations made by data annotators assessing AI-generated Python code. Your mission: ensure that the evaluations adhere to strict standards around functionality, instruction-following, and factual accuracy.

You’ll work within a fast-moving team, using your technical expertise to help shape the training data that powers cutting-edge AI systems.

What You'll Do

• Audit and review annotator evaluations of Python code generated by AI.
• Confirm that code is functional, accurate, and follows the given instructions.
• Validate technical correctness using hands-on proof-of-work — including execution in Docker environments.
• Flag and correct inconsistencies or errors in annotator feedback.
• Provide constructive guidance to annotators to uphold quality standards.
• Follow strict evaluation protocols as defined by

  Project Atlas

  .

Required Qualifications

• 5–7+ years in Python development, QA, or code review roles.
• Strong understanding of Python syntax, testing, debugging, and edge cases.
• Proficient with Docker for code execution and environment replication.
• Comfortable working in structured QA or annotation workflows.
• Excellent written communication skills.
• English proficiency at B2+ level or higher.

Preferred Experience

• Familiarity with LLM evaluation, AI training data, or RLHF workflows.
• Hands-on experience with annotation platforms or structured data review pipelines.
• Understanding of model alignment and evaluation techniques in AI.

Interested candidates kindly share resumes on shikha@digifocal.in