As a Senior Software Engineer on the Cloud-Lake team, you will play a critical role in driving Uber s batch data infrastructure to the cloud. You ll be responsible for building scalable, reliable systems that automate dataset replication, orchestrate workload migrations, and ensure data integrity and performance across hybrid environments. You will collaborate with infra, platform, and product teams to migrate hundreds of PBs of data and thousands of pipelines, minimizing customer impact and ensuring strong observability and resilience during the transition. This role is central to delivering on Uber s long-term cost, performance, and scalability goals.
What the Candidate Will Need / Bonus Points
What the Candidate Will Do ----
Lead design and development of critical migration components like dataset replication, workload redirection, and metadata reconciliation.
Own key modules such as state tracking, observability tooling, rollback workflows, or migration planners.
Collaborate with infra, data platform, and product teams to define migration strategies, create scalable solutions, and align on delivery timelines.
Proactively identify gaps in current migration tooling, propose improvements, and drive execution.
Work closely with stakeholders to ensure seamless migration of workloads, accurate lineage mapping, and minimal customer disruption.
Take ownership of production reliability, implement alerting for silent failures, and drive initiatives for automatic anomaly detection.
Represent the team in architecture reviews, technical deep-dives, and operational postmortems.
Basic Qualifications ----
8+ years of software engineering experience, including backend development in
Java, Go, or Python
. Strong understanding of
distributed systems
, data processing frameworks (e.g., Spark, Hive, Presto)
, and cloud-native services (e.g., GCS, S3, BigQuery)
. Proven experience designing and operating
fault-tolerant
, scalable systems
in production. Proficiency with
batch job orchestration tools
(e.g., Airflow, Piper) and monitoring/observability best practices. Experience working with
large-scale data systems
, including large scale upgrades, storage optimisations and handling consistency / availability challenges Strong debugging skills, ownership mindset, and the ability to work across team boundaries.
Preferred Qualifications ----
Bachelors (or Masters) in Compute Science
Experience leading projects that span multiple teams and domains.
Prior exposure to
cloud migration initiatives
or hybrid cloud/on-prem transitions. Knowledge of metadata management, data lineage, and data governance systems.
Experience in
building internal platforms or tooling
to improve engineering productivity and reduce operational burden. Strong communication skills and a history of mentoring or guiding junior engineers.
*Accommodations may be available based on religious and/or medical conditions, or as required by applicable law.