Home
Jobs

LLM Evaluation & Repository Validation (Rust or Ruby or Golang or C#)

5 years

0 Lacs

Posted:1 day ago| Platform: Linkedin logo

Apply

Work Mode

Remote

Job Type

Temporary

Job Description

Senior SW Engineer – Rust (LLM Evaluation & Repository Validation) 

What does day-to-day look like:


Analyze and triage GitHub issues across trending open-source libraries.


Set up and configure code repositories, including Dockerization and environment setup.


Evaluating unit test coverage and quality.


Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.


Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.


Opportunities to lead a team of junior engineers to collaborate on projects.


Required Skills:


Minimum 5+ years of overall experience


Strong experience with at least one of the following languages: Rust or Ruby or Golang


Proficiency with Git, Docker, and basic software pipeline setup.


Ability to understand and navigate complex codebases.


Comfortable running, modifying, and testing real-world projects locally.


Experience contributing to or evaluating open-source projects is a plus.


Nice to Have:


Previous participation in LLM research or evaluation projects.


Experience building or testing developer tools or automation agents.


Perks of Freelancing:


Work in a fully remote environment.


Opportunity to work on cutting-edge AI projects with leading LLM companies.


Offer details:


Commitment required: 20 hours per week with some overlap with PST


Employment type: Contractor assignment (no medical/paid leave)


Duration of contract: 3 months with expected start date as next week

Mock Interview

Practice Video Interview with JobPe AI

Start Evaluation Interview Now
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Rust Skills

Practice Rust coding challenges to boost your skills

Start Practicing Rust Now