Al Product Eval - TPM

Technical Program Manager – AI Evaluation & Automation (1 roles)

Role Overview

We are seeking a highly skilled Technical Program Manager (TPM) to lead an AI evaluation and automation program focused on dataset development, model assessment, and toolchain integration for Google’s AI products (e.g., Gemini CLI, Code Review Agent). This role will drive governance, stakeholder alignment, and delivery excellence across multi-disciplinary engineering teams.

Key Responsibilities

• Own end-to-end program governance, including planning, execution, and reporting of AI evaluation workstreams.

• Translate Google’s evaluation and labeling guidelines into operational execution plans and success metrics.

• Manage cross-functional alignment between AI engineers, raters, and automation teams.

• Define KPIs and ensure timely delivery of datasets, evaluation pipelines, and benchmarking reports.

• Lead risk, dependency, and quality management across distributed teams.

• Present progress, insights, and recommendations to Google stakeholders and leadership.

• Ensure compliance with data handling, labeling, and security policies.

Required Skills & Experience

• 8–12 years of experience in technical program or product management, preferably in AI/ML or data-driven environments.

• Deep understanding of machine learning evaluation processes, LLM workflows, and automation tools.

• Proven experience managing cross-geography teams and agile delivery models.

• Proficiency with Google AI ecosystem tools (Vertex AI, Gemini CLI, BigQuery, Looker).

• Excellent communication, stakeholder management, and documentation skills.

• Familiarity with Git-based systems (GitHub, GitLab, Bitbucket).

Preferred Qualifications

• Experience managing AI evaluation or model benchmarking programs.

• Background in software engineering or data science.

• PMP or Agile certification preferred.