Technical Program Manager AI Evaluation & Automation

Role Overview

• We are seeking a highly skilled Technical Program Manager (TPM) to lead an AI evaluation and automation program focused on dataset development, model assessment, and toolchain integration for Googles AI products (e g , Gemini CLI, Code Review Agent)
• This role will drive governance, stakeholder alignment, and delivery excellence across multi-disciplinary engineering teams

Key Responsibilities

• Own end-to-end program governance, including planning, execution, and reporting of AI evaluation workstreams.
• Translate Googles evaluation and labeling guidelines into operational execution plans and success metrics.
• Manage cross-functional alignment between AI engineers, raters, and automation teams.
• Define KPIs and ensure timely delivery of datasets, evaluation pipelines, and benchmarking reports.
• Lead risk, dependency, and quality management across distributed teams.
• Present progress, insights, and recommendations to Google stakeholders and leadership.
• Ensure compliance with data handling, labeling, and security policies.

Required Skills & Experience

• 8-12 years of experience in technical program or product management, preferably in AI/ML or data-driven environments.
• Deep understanding of machine learning evaluation processes, LLM workflows, and automation tools.
• Proven experience managing cross-geography teams and agile delivery models.
• Proficiency with Google AI ecosystem tools (Vertex AI, Gemini CLI, BigQuery, Looker).
• Excellent communication, stakeholder management, and documentation skills.
• Familiarity with Git-based systems (GitHub, GitLab, Bitbucket).

Preferred Qualifications

• Experience managing AI evaluation or model benchmarking programs.
• Background in software engineering or data science.
• PMP or Agile certification preferred.