Data Engineer

We're Hiring: Data Engineer | Real-Time Systems | AWS | Python | Spark

Location:

Experience: 5+ years

Immediate joiners or candidates with ≤20 days' notice will be prioritised.

Are you passionate about building real-time data infrastructure that fuels cutting-edge mobility simulation and complex event processing?

Digital Twin Platform

What You’ll Do:

• Design & implement real-time streaming pipelines from IoT sensors, cameras, and vehicle telemetry
• Work with tools like

  Kinesis

  ,

  Apache Flink/Spark

  for both streaming and batch processing
• Manage

  time-series data

  , sliding windows, and mobility pattern pipelines
• Integrate simulation outputs into data lakes (AWS) and maintain data validation frameworks
• Collaborate with Data Scientists & Simulation Engineers to optimize formats like

  Parquet

  ,

  Protobuf

  ,

  Delta Lake

• Deploy and monitor on

  AWS

  and edge infrastructure

What You Bring:

• 5+ years of experience (3+ in Data Engineering focused on real-time systems)
• Expertise in

  Python

  ,

  SQL

  , and distributed systems
• Strong grasp of

  event-driven architectures

  ,

  data lakes

  ,

  message serialization

• Hands-on with

  sensor/telemetry data

  ,

  CI/CD

  ,

  Docker

  ,

  Kubernetes

  , and

  Airflow

Bonus Skills:

• Familiarity with

  V2X

  ,

  smart city platforms

  , or other time-series ecosystems
• Experience integrating camera and sensor data into high-volume pipelines

Interested candidates can share their resumes on shyam.kishore@zerolagsol.com

#DataEngineer #Hiring #Python #AWS #StreamingData #Spark #Flink #DigitalTwin #MobilityTech #IoT #Simulation #CareerOpportunity