SDE 3- Data Engineer

SDE III – Data Engineer

Role Overview

high-impact, senior individual contributor role

Key Responsibilities

Data Engineering & Architecture

• Design, build, and optimize

  large-scale data pipelines

  , batch and streaming, using

  Apache Spark, PySpark, and Apache Spark Streaming

  .
• Architect and manage data lake and data warehouse systems using

  Apache Iceberg, Apache Pinot, and Presto

  .
• Build high-performance, low-latency ingestion systems for real-time analytics.
  
• Ensure reliability, scalability, and performance of data pipelines and distributed systems.
  

Engineering Excellence

• Write clean, efficient, high-quality code using

  Java

  and

  Python

  .
• Optimize SQL and data models across

  MySQL and other relational databases

  .
• Own and drive CI/CD workflows for automated deployment and testing of data services.
  

Cloud & Infrastructure

• Build and manage data infrastructure on cloud platforms (AWS, GCP, or Azure).
  
• Implement best practices for data governance, security, lineage, and observability.
  
• Manage large-scale storage, compute clusters, and distributed data systems.
  

Leadership & Collaboration

• Lead technical initiatives across teams, working closely with Product, Analytics, and Engineering stakeholders.
  
• Mentor junior engineers and contribute to Flyin’s engineering culture.
  
• Break down complex requirements into clear, actionable technical plans.
  
• Drive ownership, accountability, and engineering excellence across the team.
  

Required Skills & Experience

• 4-7 years of experience in

  Data Engineering

  with strong big data fundamentals.
• Proficient in

  Java

  and

  Python

  for backend and data development.
• Strong expertise in

  PySpark, Apache Spark, Spark Streaming

  .
• Hands-on experience with

  Apache Iceberg, Apache Pinot, Presto

  (any two is acceptable).
• Deep knowledge of SQL, relational databases (MySQL preferred), and distributed systems.
  
• Experience designing and managing cloud-native data infrastructure (AWS/GCP/Azure).
  
• Strong experience with

  CI/CD pipelines

  , Git, and DevOps tooling.
• Strong understanding of data modeling, ETL/ELT frameworks, and data quality.
  
• Proven ability to lead cross-functional technical initiatives.
  
• Experience mentoring engineers or leading small teams/projects.
  

Preferred Qualifications

• Experience working in high-traffic, real-time consumer products (travel, e-commerce, fintech).
  
• Knowledge of streaming frameworks like

  Flink

  is a plus.
• Experience with open-source data lake technologies and query engines.
  
• Exposure to ML data pipelines is a plus.