This role is for one of the Weekday's clients
Min Experience: 9 yearsLocation: IndiaJobType: full-timeWe are looking for an experienced
Staff Software Engineer
to play a critical role in designing, building, and scaling next-generation
data lake and query processing platforms
. This role is ideal for a hands-on technical leader who thrives in complex, distributed systems and enjoys solving large-scale data challenges. You will work closely with platform, infrastructure, and product teams to deliver high-performance, reliable, and scalable data systems that power analytics, real-time processing, and business intelligence across the organization.As a Staff Engineer, you will influence architectural decisions, drive technical excellence, and mentor senior engineers while remaining deeply involved in coding and system design.
Requirements
Key Responsibilities
- Design, develop, and evolve large-scale data lake architectures supporting batch and real-time workloads.
- Build and optimize query engines for high-throughput, low-latency analytics over massive datasets.
- Lead the implementation and optimization of Apache Iceberg for table management, schema evolution, partitioning, and transactional consistency.
- Design and maintain streaming and event-driven systems using Kafka, ensuring fault tolerance, scalability, and data reliability.
- Develop high-performance backend services and data processing components using Java, Scala, and C++.
- Drive architectural reviews and make data-driven decisions around storage formats, indexing strategies, and query execution plans.
- Collaborate closely with data engineers, infrastructure teams, and product stakeholders to translate business needs into scalable technical solutions.
- Ensure system reliability through robust testing, monitoring, and performance tuning.
- Mentor and guide engineers across teams, setting best practices for coding, system design, and operational excellence.
- Take ownership of complex technical problems and lead them from design through production deployment.
Required Skills & Qualifications
- 9-13 years of experience in software engineering with a strong focus on distributed systems and data platforms.
- Deep expertise in Data Lake technologies and large-scale data processing architectures.
- Strong hands-on experience with Apache Iceberg, including table formats, metadata management, and performance optimization.
- Solid understanding of query engines (distributed SQL engines, query planners, execution frameworks).
- Extensive experience with Kafka and streaming data pipelines.
- Excellent programming skills in Java and Scala; strong proficiency in C++ for performance-critical systems.
- Strong knowledge of concurrency, memory management, and performance tuning in distributed environments.
- Experience working with cloud-based or on-premise big data ecosystems.
Nice to Have
- Experience with open-source contributions in data or query systems.
- Exposure to other table formats or query engines (e.g., Hive, Presto, Trino, Spark).
- Strong system design and technical leadership background.
