Team Lead- Data Annotation

LLM & Annotation Work

• Design, refine, and evaluate prompts for LLM-based workflows to improve accuracy, relevance, and output quality.
• Perform and oversee 

  Audio/Video (AV) annotations

  , including labeling, quality checks, and dataset creation.
• Collaborate with model developers to provide data-driven insights, edge-case examples, and improvement suggestions.
• Conduct systematic testing of LLM features, identify issues, and guide improvements.

2. KPI Strategy & Performance Management

• Define clear 

  Key Performance Indicators (KPIs)

   for LLM evaluation, annotation quality, and operational excellence.
• Build monitoring dashboards, scorecards, and tracking mechanisms for ongoing performance analysis.
• Identify performance gaps, generate insights, and recommend corrective actions.
• Lead periodic review meetings and present performance trends to leadership and stakeholders.

3. Leadership & Stakeholder Management

• Mentor junior annotators, analysts, or contractors involved in LLM evaluation tasks.
• Coordinate with product, engineering, and operations stakeholders to align objectives and deliverables.
• Drive process improvements to increase efficiency, reduce errors, and enhance data quality.
• Communicate effectively to ensure stakeholder alignment throughout the project lifecycle.

Required Skills

• Hands-on experience with LLMs

  , including prompt design, output evaluation, and annotation workflows (text/AV).
• Strong understanding of 

  KPI creation, tracking, and reporting

   for model evaluation and team performance.
• Proven 

  leadership and stakeholder-management

   capabilities in fast-paced environments.
• Excellent analytical, problemsolving, and documentation skills.
• Familiarity with tools like Excel/Sheets, dashboards, QA tools, or annotation platforms (advantageous).

Experience

• 3+ years total professional experience

  , with

• 1+ years of direct experience

   working with LLM systems, prompt engineering, or annotation pipelines.
• Experience in KPI-driven performance environments, QA operations, or data evaluation roles.