Software Engineer – Rust (LLM Evaluation & Repository Validation)

Role: Sr. SW Engineer – Rust (LLM Evaluation & Repository Validation)

Engagement Length: 3 months

Location: Remote

Skills req: Rust - 4 yrs

What does day-to-day look like:

·  Analyze and triage GitHub issues across trending open-source libraries.

·  Set up and configure code repositories, including Dockerization and environment setup.

·  Evaluating unit test coverage and quality.

·  Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.

·  Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.

·  Opportunities to lead a team of junior engineers to collaborate on projects.

Required Skills:

·  Minimum 5+ years of overall experience

·  Strong experience with Rust.

·  Proficiency with Git, Docker, and basic software pipeline setup.

·  Ability to understand and navigate complex codebases.

·  Comfortable running, modifying, and testing real-world projects locally.

·  Experience contributing to or evaluating open-source projects is a plus.

Nice to Have:

·  Previous participation in LLM research or evaluation projects.

·  Experience building or testing developer tools or automation agents.

Perks:

·      Work in a fully remote environment.

·      Opportunity to work on cutting-edge AI projects with leading LLM companies.