Senior Software Engineer Golang (LLM Evaluation & Repository Validation)

You are seeking experienced Golang software engineers (tech lead level) proficient in working with high-quality public GitHub repositories. The ideal candidate should have a background in collaborating on well-maintained, widely-used repos with 5000+ stars. In this role, you will engage in hands-on software engineering tasks, such as automating development environments, triaging issues, and assessing test coverage and quality. Your responsibilities will include evaluating how LLMs interact with actual code, thus playing a pivotal role in shaping the future of AI-assisted software development. This position offers a unique opportunity to merge practical software engineering with AI research. Your daily activities will revolve around analyzing and triaging GitHub issues related to trending open-source libraries, setting up and configuring code repositories (including Dockerization and environment setup), evaluating unit test coverage and quality, running and modifying codebases to assess LLM performance in bug-fixing scenarios, and collaborating with researchers to identify challenging repositories and issues for LLMs. Additionally, there will be opportunities to lead a team of junior engineers on collaborative projects. The following skills are required for this role: - Strong proficiency in Golang - Sound knowledge of Git, Docker, and basic software pipeline setup - Ability to comprehend and navigate complex codebases - Comfort with running, modifying, and testing real-world projects locally - Experience in contributing to or evaluating open-source projects is advantageous Nice to have qualifications include: - Prior involvement in LLM research or evaluation projects - Background in developing or testing developer tools or automation agents As a freelancer with AquSag, you will enjoy the following perks: - Fully remote working environment - Opportunity to engage in cutting-edge AI projects with leading LLM companies,