Biz Tech Consultants logo

AI Evaluator - Java (Freelance Opportunity)

Biz Tech Consultants

3 - 8 years

India

Posted:4 days ago

Job Description

Job Description

We are looking for experienced software engineers to work on RLHF projects that support the training and evaluation of AI coding agents. Depending on the project, the work can involve designing realistic technical tasks, or reviewing and rating AI generated responses for correctness, clarity, and reliability. It suits engineers who enjoy precise technical writing and careful quality review as much as building.

Key Responsibilities

Design technical tasks across areas such as software development, debugging, data processing, security, and machine learning, and set up any supporting environment and automated tests needed to validate them, where the project calls for task authoring.

Review AI generated responses to technical tasks, assessing correctness, code quality, and adherence to instructions.

Provide clear, evidence based written feedback and comparative ratings across responses.

Validate task or evaluation difficulty against AI model outputs and revise based on review feedback.

Desired Candidate Profile

Highly Required

4 to 7 years of experience building production systems, not just internal tools.

Strong hands-on skill in Java

Comfortable working with Docker and command line tools.

Comfortable working with one relational and one NoSQL database.

Can point to a clear before and after metric from past work.

Experience working with remote or international clients or teams.

Some exposure to secure data handling or compliance work.

Preferred

Has integrated an AI or LLM API into a real, shipped feature.

Experience in AI training and evaluation work.

Prior experience debugging, reviewing code, and writing documentation or test cases.

Employment Type Contractual/Freelance

Key Skills Python, Java, JavaScript, Node.js, Go, Rust, Docker, Git, pytest, AI Integration, LLM, NoSQL, CI/CD, System Design

Nice to Have Kubernetes, Kafka, RabbitMQ, gRPC, Redis

Skills Required

Artificial Intelligence Freelancing SQL Engineering Software engineering Java Software Evaluation

Learn the skills this job asks for

Free courses, interview questions and practice for each skill.

Work Mode

Remote

Job Type

Part Time

Mock Interview

Practice Video Interview with JobPe AI

Start Artificial Intelligence Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Java Skills

Practice Java coding challenges to boost your skills

Start Practicing Java Now
Biz Tech Consultants logo
Biz Tech Consultants

RecommendedJobs for You