Manager, PGM Tech - Frontier Labs

5 - 10 years

10 - 15 Lacs

Posted:1 day ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

About the Role

Program Manager

end-to-end execution

high-ambiguity, high-velocity environments

---- What You Will Do ----

Program Execution & Delivery

  1. Manage AI data labeling programs from

    scoping to delivery

    , ensuring high-quality annotations at scale.
  2. Translate

    Frontier Labs research needs

    into concrete annotation specs, rubrics, and task designs.
  3. Own timelines, throughput plans, and quality controls for critical datasets used in LLM training and evaluation.

Stakeholder Management

  1. Partner with researchers, data scientists, product, and ops to ensure labeling goals are aligned with model objectives.
  2. Work cross-functionally to drive task clarity, resolve ambiguity, and incorporate feedback into successive batches.
  3. Act as the

    single-threaded owner

    for specific labeling programs, managing internal and external partners.

Operational Infrastructure

  1. Develop and refine

    batching strategies

    ,

    smart sampling plans

    , and

    audit workflows

    .
  2. Drive

    QA processes

    , including golden set calibration, rubric refinement, and disagreement adjudication.
  3. Ensure traceability from

    raw inputs to final labeled outputs

    , and track quality regressions over time.

Process Design & Automation

  1. Identify opportunities to apply

    model-in-the-loop labeling

    ,

    active learning

    , or

    self-checking pipelines

    .
  2. Collaborate with tool owners and engineers to integrate annotation workflows with internal tooling systems.
  3. Own feedback loops that enable raters to improve over time and reduce error variance

---- What You Will Need ----

  • Bachelors degree

    in Engineering, Data Science, Linguistics, or related technical/analytical field.
  • 5+ years

    of program or project management experience in AI/ML, data ops, or labeling infrastructure.
  • Demonstrated ability to manage

    end-to-end data pipelines

    in AI/ML or research environments.
  • Strong working knowledge of

    Robotics, Physical AI Data labeling tasks

    , such as:
  1. Object detection and recognition
  2. Semantic & Instance Segmentation
  3. Depth & Pose Estimation
  4. Grasp Detection
  5. Action Segmentation
  6. Trajectory Labeling
  7. Prompt-response evaluation
  8. Instruction tuning
  9. Dialogue evaluation
  10. Vision-language QA
  11. Video slot tagging
  12. Image Tagging
  13. Documentation Extraction
  14. Data collection annotation
  15. HRI
  • Experience collaborating with research or model teams to scope data collection requirements.
  • Excellent written and verbal communication skills

---- Preferred Qualifications ----

  1. Experience in

    frontier AI research environments

    , such as foundation model labs or GenAI startups.
  2. Familiarity with tools like

    Label Studio, Scale AI, SuperAnnotate, Snorkel Flow, or in-house annotation platforms

    .
  3. Understanding of LLM training and evaluation lifecycles.
  4. Experience working with

    human-in-the-loop systems

    or model-assisted labeling pipelines.
  5. Familiarity with

    multilingual or multi-cultural annotation programs

Mock Interview

Practice Video Interview with JobPe AI

Start Data Science Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Uber logo
Uber

Technology, Information and Internet

San Francisco California

RecommendedJobs for You