Lead Data Engineer

About The Function

About The Team

Our Team's Key Responsibilities Are

• Design, construct, and maintain robust data systems and architectures
• Develop and optimize data capture, storage, processing, serving, and querying platforms
• Create data products for personalization, recommendation, customer segmentation, and intelligence
• Enhance our Measurement platform for A/B experimentation
• Contribute to our Feature Store, an internal unified data analytics platform
• Participate in the development of our next-generation Travel Planner using Generative AI and Multi-Agent frameworks.
• Implement and optimize data solutions for travel-specific use cases, such as:
• Analyzing cross-city travel patterns to extend trip recommendations
• Identifying correlations between hotel bookings in different areas to suggest complementary destinations
  

Required Skills And Experience

• Extensive experience working with large data sets with hands-on technology skills to design and build robust data architecture
• At least 6+ years of hands-on experience in Spark/BigData Tech stack
• Expertise in stream processing engines like Spark Structured Streaming or Apache Flink
• Analytical processing on Big Data using Spark
• At least 4+ years of experience in Scala. Experience with Python will be a plus.
• Hands-on administration, configuration management, monitoring, performance tuning of Spark workloads, Distributed platforms, and JVM based systems
• At least 2+ years of cloud deployment experience – AWS | Azure | Google Cloud Platform
• 2 or more product deployments of big data technologies – Business Data Lake, NoSQL databases etc
• Awareness and decision-making ability to choose among various big data, NoSQL, analytics tools and technologies
• Should have experience in architecting and implementing domain centric big data solutions
• Ability to frame architectural decisions and provide technology leadership & direction
• Excellent problem solving, hands-on engineering, and communication skills