Remote Senior Software Engineer

About the projects: We are currently involved in developing LLM evaluation and training datasets to train LLM for handling real-world software engineering challenges effectively. As part of this project, we are focusing on creating verifiable SWE tasks by utilizing public repository histories in a synthetic approach with human-in-the-loop. Our goal is to expand the dataset coverage to encompass various types of tasks, including different programming languages, difficulty levels, and more. About the Role: We are seeking experienced software engineers, particularly at the tech lead level, who possess familiarity with high-quality public GitHub repositories and are enthusiastic about contributing to our project. The ideal candidate should have a background in working with well-maintained, widely-used repositories that have garnered 500+ stars. This role entails hands-on software engineering tasks such as development environment automation, issue triaging, and assessing test coverage and quality. Why Join Us Joining our team means becoming a part of Turing, one of the fastest-growing AI companies globally dedicated to accelerating the advancement and deployment of powerful AI systems. You will play a pivotal role in evaluating how LLMs interact with actual code, thereby influencing the future of AI-assisted software development. This position offers a unique opportunity to merge practical software engineering with AI research. What does day-to-day look like: - Analyzing and triaging GitHub issues within popular open-source libraries. - Setting up and configuring code repositories, involving Dockerization and environment setup. - Evaluating unit test coverage and quality. - Modifying and running codebases locally to assess LLM performance in bug-fixing scenarios. - Collaborating with researchers to identify challenging repositories and issues for LLMs. - Leading a team of junior engineers on collaborative projects. Required Skills: The successful candidate should possess: - Strong expertise in at least one of the following languages: Python, JavaScript, Java, Go, Rust, C/C++, C#, or Ruby. - Experience in working with well-maintained, widely-used repositories that have 500+ stars. - Proficiency in Git, Docker, and basic software pipeline setup. - Ability to comprehend and navigate intricate codebases. - Comfort with running, modifying, and testing real-world projects locally. - Bonus: Experience in contributing to or evaluating open-source projects. Note: Prior experience with well-maintained, widely-used repositories (500+ stars) is mandatory. Nice to Have: - Previous involvement in LLM research or evaluation projects. - Background in building or testing developer tools or automation agents. Perks of Freelancing With Turing: - Work in a fully remote environment. - Opportunity to engage in cutting-edge AI projects with leading LLM companies. Offer details: - Commitment required: 20 hours per week with some overlap with PST. - Employment type: Contractor assignment (no medical/paid leave). - Duration of contract: 1 month with an expected start date next week. - Rates: $40-$100/hour, based on experience and skill level.,