Job
Description
About The Role As a Senior Software Engineer on the Cloud-Lake team, you will play a critical role in driving Uber's batch data infrastructure to the cloud. You'll be responsible for building scalable, reliable systems that automate dataset replication, orchestrate workload migrations, and ensure data integrity and performance across hybrid environments. You will collaborate with infra, platform, and product teams to migrate hundreds of PBs of data and thousands of pipelines, minimizing customer impact and ensuring strong observability and resilience during the transition. This role is central to delivering on Uber's long-term cost, performance, and scalability goals. What The Candidate Will Need / Bonus Points ---- What the Candidate Will Do ---- Lead design and development of critical migration components like dataset replication, workload redirection, and metadata reconciliation. Own key modules such as state tracking, observability tooling, rollback workflows, or migration planners. Collaborate with infra, data platform, and product teams to define migration strategies, create scalable solutions, and align on delivery timelines. Proactively identify gaps in current migration tooling, propose improvements, and drive execution. Work closely with stakeholders to ensure seamless migration of workloads, accurate lineage mapping, and minimal customer disruption. Take ownership of production reliability, implement alerting for silent failures, and drive initiatives for automatic anomaly detection. Represent the team in architecture reviews, technical deep-dives, and operational postmortems. Basic Qualifications 8+ years of software engineering experience, including backend development in Java, Go, or Python . Strong understanding of distributed systems , data processing frameworks (e.g., Spark, Hive, Presto) , and cloud-native services (e.g., GCS, S3, BigQuery) . Proven experience designing and operating fault-tolerant , scalable systems in production. Proficiency with batch job orchestration tools (e.g., Airflow, Piper) and monitoring/observability best practices. Experience working with large-scale data systems , including large scale upgrades, storage optimisations and handling consistency / availability challenges Strong debugging skills, ownership mindset, and the ability to work across team boundaries. Preferred Qualifications Bachelors (or Masters) in Compute Science Experience leading projects that span multiple teams and domains. Prior exposure to cloud migration initiatives or hybrid cloud/on-prem transitions. Knowledge of metadata management, data lineage, and data governance systems. Experience in building internal platforms or tooling to improve engineering productivity and reduce operational burden. Strong communication skills and a history of mentoring or guiding junior engineers.
