We’re hiring a Code Reviewer with deep Python expertise to review evaluations completedby data annotators assessing AI-generated Python code responses. Your role is to ensurethat annotators follow strict quality guidelines related to instruction-following, factualcorrectness, and code functionality.

Responsibilities

Review and audit annotator evaluations of AI-generated Python code.
Assess if the Python code follows the prompt instructions, is functionally correct,

and secure.

Validate code snippets using proof-of-work methodology.
Identify inaccuracies in annotator ratings or explanations.
Provide constructive feedback to maintain high annotation standards.
Work within Project Atlas guidelines for evaluation integrity and consistency.

Required Qualifications

5–7+ years of experience in Python development, QA, or code review.
Strong knowledge of Python syntax, debugging, edge cases, and testing.
Comfortable using code execution environments and testing tools.
Excellent written communication and documentation skills.
Experience working with structured QA or annotation workflows.
English proficiency at B2, C1, C2, or Native level.

Preferred Qualifications

Experience in AI training, LLM evaluation, or model alignment.
Familiarity with annotation platforms.
Exposure to RLHF (Reinforcement Learning from Human Feedback) pipelines.

Skills: python,reinforcement learning from human feedback,debugging,llm evaluation,testing,communication,qa,docker,model alignment,testing tools,ai-generated python code,annotation workflows,c2,code review,ai training,b2,code execution environments,rlhf

More Jobs at Cognisol

Sales and marketing freshers

Chennai, Tamil Nadu, India

3 - 3 yrs

Salary: Not disclosed

Business Development Manager – Sales

Chennai, Tamil Nadu, India

Experience: Not specified

Salary: Not disclosed

Relationship Manager – Sales

Chennai, Tamil Nadu, India

Experience: Not specified

Salary: Not disclosed

Business Development Manager – Sales

Chennai, Tamil Nadu, India

Experience: Not specified

Salary: Not disclosed

Relationship Manager – Sales

Chennai, Tamil Nadu, India

Experience: Not specified

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

Cognisol

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Upskill and Grow with AI

Python Developer