Posted:1 day ago|
Platform:
On-site
Full Time
We are looking for a skilled Data Engineer to build and optimize data pipelines for a real-time Digital Twin platform powering mobility simulation, complex event processing, and multi-agent learning.
You'll design the backbone for scalable, low-latency ingestion and processing of high-volume sensor, vehicle, and infrastructure data to feed prediction models and simulations.
Responsibilities: Design and implement streaming data pipelines from IoT sensors, camera, vehicle telemetry, and infrastructure systems. Build scalable infrastructure using Kinesis, Apache Flink / Spark for real-time and batch workloads.
Enable time-series feature stores and sliding window processing for mobility patterns.
Integrate simulation outputs and model predictions into data lakes in AWS.
Maintain data validation, schema versioning, and high-throughput ingestion.
Collaborate with Data Scientists and Simulation Engineers to optimize data formats (e.g., Parquet, Protobuf, Delta Lake).
Deploy and monitor pipelines on AWS cloud and/or edge infrastructure.
Requirements: 3+ years of experience in data engineering, preferably with real-time systems.
Overall 5+ Years of experience Proficient with Python, SQL, and distributed data systems (Kinesis, Spark, Flink, etc.).
Strong understanding of event-driven architectures, data lakes, and message serialization.
Experience with sensor data processing, telemetry ingestion, or mobility data is a plus. Familiarity with Docker, CI/CD, Kubernetes, and cloud-native architectures. Familiarity with bulding data pipelines & its workflows (eg: Airflow).
MNR Solutions Pvt Ltd
Upload Resume
Drag or click to upload
Your data is secure with us, protected by advanced encryption.
Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.
We have sent an OTP to your contact. Please enter it below to verify.
Instantly access job listings, apply easily, and track applications.
Practice Python coding challenges to boost your skills
Start Practicing Python Now
Chennai, Bengaluru, Mumbai (All Areas)
3.75 - 8.0 Lacs P.A.
Hyderabad
2.0 - 6.0 Lacs P.A.
Hyderabad
25.0 - 30.0 Lacs P.A.
Bengaluru
25.0 - 30.0 Lacs P.A.
Gurugram
11.0 - 15.0 Lacs P.A.
Bengaluru
8.0 - 13.0 Lacs P.A.
Bengaluru
6.0 - 9.0 Lacs P.A.
Bengaluru
5.0 - 7.0 Lacs P.A.
Hyderabad
18.0 - 32.5 Lacs P.A.
Bengaluru
4.0 - 7.0 Lacs P.A.
