Software Engineer (Terminal-Bench)

Company Description

Dusker AI is an innovation-driven company focused on advancing AI systems through high-quality data, evaluation, and benchmarking. We specialize in building and optimizing large-scale benchmarks such as Terminal-Bench and developing automated workflows that test the real-world capabilities of AI agents. Our mission is to strengthen the reliability, accuracy, and robustness of AI models by creating challenging, reproducible, and research-grade evaluation environments.

By combining deep technical expertise in systems engineering, automation, and developer tooling, we help organizations build AI agents that perform consistently in real-world terminal-based environments. Dusker AI is committed to raising the standards of AI evaluation through rigorous engineering and precise benchmarking practices.

Role Description

We are seeking a highly skilled Software Engineer (Terminal-Bench) for a 3-month contract with a strong possibility of extension.

This is a fully remote role where you will work on designing, maintaining, and improving Terminal-Bench tasks, automation pipelines, and evaluation workflows.

You will work extensively in Linux/Ubuntu environments, write efficient Bash scripts, debug complex terminal behaviors, and manage Docker-based execution setups.

The role requires independently analyzing issues, improving task reliability, documenting processes, and collaborating with remote engineering teams to enhance the performance and accuracy of benchmarking systems.

Qualifications

Strong proficiency in Linux/Ubuntu command-line operations

Expertise in Bash scripting and terminal automation

Hands-on experience with Docker containers, environment setups, and isolation workflows

Understanding of system calls, processes, filesystems, and core OS behaviors

Familiarity with Terminal-Bench, OSWorld-SFT, or similar evaluation ecosystems (preferred)

Excellent debugging and problem-solving abilities

Ability to work effectively in a fully remote environment with high attention to detail

Bachelor’s or Master’s degree in Computer Science, Engineering, IT, or related field (preferred but not mandatory)

Compensation

₹12–15 LPA (India)

$8–$10 per hour (International)

Employment Type

Contract — 3 Months

High chance of extension

Location

• Remote — Global