Senior Tech Lead, Data Platform

Overview

Senior Tech Lead, Data Platform

Responsibilities

Team Leadership & Delivery: Lead the planning, execution, and delivery of data platform features,taking ownership of your team's sprints and roadmap commitments.Hands-On Development: Act as the most senior developer on the team, writing clean, maintainable,and well-tested code for critical components, particularly within the Apache Spark and Kubernetesecosystem.Code Quality & Best Practices: Uphold a high standard of engineering excellence by conductingthorough code reviews, establishing best practices for testing and deployment, and championing cleancode principles.Mentorship & Coaching: Mentor and develop the engineers on your team, helping them grow theirtechnical skills and advance their careers.Unblocking the Team: Act as the primary technical point of contact for your team, resolving technicalchallenges, making pragmatic design decisions, and ensuring the team has what it needs to succeed.Operational Excellence: Lead the charge on improving the observability, reliability, and performanceof our data pipelines and platform components.

Requirements

Required Qualifications7+ years of hands-on software engineering experience, with a focus on data-intensive systems.2+ years of experience in a formal or informal technical leadership role, including mentoringengineers and leading project delivery.Expert-level programming skills in Python (PySpark) or Scala.Strong, hands-on experience with Apache Spark, including application development andperformance tuning.Solid understanding of Kubernetes and experience deploying applications to it.Proven ability to break down complex projects into manageable tasks and drive them to completion.

Preferred Qualifications

Experience with workflow orchestration tools like Airflow or Argo Workflows.Experience building and maintaining CI/CD pipelines (e.g., GitLab CI, Jenkins).Familiarity with S3-compatible object storage (MinIO, AWS S3) and table formats (Apache Iceberg,Delta Lake).Experience with interactive SQL engines like Trino.