Staff Software Engineer

This role is for one of the Weekday's clients

Staff Software Engineer

query engines

data lakes

Java or Scala

Requirements

Key Responsibilities:

• Design, develop, and maintain query engines capable of processing large-scale datasets efficiently.
• Build and optimize data pipelines and integrations with data lakes to ensure high throughput and low latency.
• Collaborate with cross-functional teams including Data Engineering, Data Science, and Product Engineering to deliver scalable and performant solutions.
• Evaluate and implement new technologies, frameworks, and architectures to improve query performance, reliability, and maintainability.
• Lead system design discussions, ensuring technical decisions align with long-term business goals.
• Mentor and guide junior engineers, providing technical direction and best practices for software development and system design.
• Troubleshoot, analyze, and resolve complex issues in distributed systems, ensuring high availability and fault tolerance.
• Contribute to coding standards, architecture guidelines, and code reviews, promoting a culture of quality and innovation.
  

Required Skills & Qualifications:

• Experience: 9-13 years of professional software engineering experience, preferably in data-intensive environments.
• Programming: Proficient in Java or Scala, with a strong understanding of concurrent programming, memory management, and performance optimization.
• Query Engine Expertise: Hands-on experience in building, tuning, or maintaining query engines (e.g., Presto, Spark SQL, Hive, or similar).
• Data Lakes & Big Data: Solid experience working with data lakes and distributed storage systems (e.g., Hadoop, AWS S3, Azure Data Lake, GCP).
• Strong understanding of distributed systems, data modeling, and data processing frameworks.
• Proven ability to design scalable, fault-tolerant systems capable of handling petabyte-scale datasets.
• Excellent problem-solving, debugging, and analytical skills, with a focus on performance optimization.
• Experience mentoring and leading engineering teams, with a collaborative and proactive mindset.
  

Preferred Qualifications:

• Familiarity with modern ETL frameworks, stream processing, or batch processing architectures.
• Knowledge of cloud-based data services and infrastructure (AWS, Azure, GCP).
• Open-source contribution or active participation in data engineering communities is a plus