Multimedia & Sensor Fusion Engineer

Job Summary

We are looking for a Multimedia & Sensor Fusion Engineer with 3–8 years of experience in real-time video streaming, multimedia pipelines, and multi-sensor systems. The role involves developing and maintaining low-latency EO/IR video ingestion, decoding, synchronization, sensor fusion, and real-time video distribution for an integrated surveillance and command system.

The ideal candidate should have strong experience with FFmpeg or GStreamer, video codecs, WebRTC, network troubleshooting, and timestamp synchronization.

Key Responsibilities

• Develop and maintain real-time video ingestion pipelines for multiple EO/IR camera feeds.
• Handle video demultiplexing, decoding, stream reconnection, and recovery from corrupted or interrupted streams.
• Optimize end-to-end video latency while supporting AI processing and operator viewing simultaneously.
• Synchronize video timestamps with GPS, INS, gimbal, and other sensor metadata.
• Integrate and publish video streams using WebRTC, LiveKit, UDP, or RTP.
• Troubleshoot packet loss, network issues, NAT/TURN, bandwidth adaptation, and streaming failures.
• Design asynchronous, backpressure-aware architectures to prevent AI workloads from blocking live video.
• Support integration of additional sensors, including radar, ESM, and AIS.
• Debug real-time synchronization and streaming issues in laboratory and field environments.

Required Skills and Experience

• 3–8 years of relevant experience in multimedia streaming, real-time media systems, ISR pipelines, or robotics perception systems.
• Strong understanding of MPEG-TS, MP4, H.264/H.265, PTS/DTS, keyframes, jitter buffers, and video latency.
• Hands-on experience with FFmpeg and/or GStreamer.
• Experience with Python media processing libraries such as PyAV, OpenCV, and Python asyncio.
• Practical experience with WebRTC, LiveKit, UDP, RTP, or multicast streaming.
• Understanding of timestamp alignment, coordinate systems such as LLA/ECEF/ENU, and gimbal or sensor transformations.
• Experience troubleshooting decoder stalls, corrupted streams, packet loss, and synchronization issues.
• Knowledge of Linux networking and network diagnostic tools such as Wireshark and tcpdump.
• Ability to design and scale pipelines supporting multiple simultaneous video feeds.
• Strong problem-solving skills and the ability to troubleshoot issues in real-time systems.

Preferred Skills

• Hardware-accelerated video decoding using NVIDIA NVDEC or CUDA.
• Knowledge of KLV/MISB metadata and STANAG standards.
• Experience with NTP/PTP time synchronization.
• Familiarity with radar tracking, ESM data, AIS, HLS archival, and multi-sensor recording and replay.

Education

B.E./B.Tech/M.Tech in Electronics and Communication Engineering, Computer Science, Multimedia, Avionics, or a related field.

Role Expectations

The engineer will be responsible for maintaining reliable, synchronized, low-latency video streams in a multi-sensor surveillance and command environment. Candidates should be able to explain their system architecture, demonstrate latency optimization, and discuss real-world streaming or synchronization issues they have resolved.

Pay: ₹800,000.00 - ₹1,000,000.00 per year

Work Location: In person