Python Full Stack Developer

Job Role: Python Full Stack Developer

Experience: 6+ Years

Skills: Python, JavaScript / Node.js, TypeScript

Shift: 3:00 PM – 12:00 / 12:30 AM IST (PST overlap required)

Role Overview

We are looking for a highly skilled Full Stack Engineer to work on Large Language Model (LLM) evaluation, tooling, and data workflows. This role focuses on writing production-quality code, building reproducible environments, and designing rigorous evaluations that improve model reliability and reasoning.

Key Responsibilities

• Write, review, and debug production-grade code across multiple languages
• Design evaluation tasks for coding, reasoning, and debugging scenarios
• Analyze LLM outputs to identify hallucinations, regressions, and failure patterns
• Build reproducible development environments using Docker and automation tools
• Develop scripts, pipelines, and tooling for data generation, scoring, and validation
• Create structured annotations, judgments, and high-quality datasets
• Run systematic evaluations to improve model accuracy, reliability, and reasoning.

Required Skills & Experience

• Strong hands-on coding experience in

  Python, JavaScript / Node.js, TypeScript

• Solid experience with

  Linux, Bash scripting, and automation

• Strong knowledge of

  Docker

  , dev containers, and reproducible environments
• Advanced

  Git

  skills (branching, diffs, patches, conflict resolution)
• Strong understanding of

  testing and QA

  (unit, integration, edge-case testing)
• Ability to overlap reliably with

  8:00 AM – 12:00 PM PT.

Nice to Have

• Experience with LLM coding tools (Cursor, Copilot, CodeWhisperer)
• Experience with dataset creation, annotation, or ML pipelines
• Familiarity with benchmarks like SWE Bench or Terminal Bench
• Background in QA automation, DevOps, ML systems, or data engineering.