Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Interviews

Home
>
Jobs in kochi
>
Iridium Cloud Systems
>
Data Engineer Streaming & APIs

Data Engineer Streaming & APIs

Iridium Cloud Systems

4 - 9 years

|

10 - 15 Lacs

kochi noida chennai

Posted:2 hours ago| Platform:

Apply

Skills Required

hadoop kafka fastapi spark kubernetes elk etl elt aws flask

Work Mode

Hybrid

Job Type

Full Time

Job Description

Purpose

Design, develop, and optimize scalable data solutions for real-time streaming and batch processing, with a focus on data enrichment, API exposure, and business intelligence.

Key Responsibilities

Architect scalable ETL/ELT data pipelines for streaming logs (Spark, Kafka) and batch processing.
Develop high-performance APIs using FastAPI to serve enriched data (e.g., IP geolocation, user mapping) to internal applications.
Integrate external data sources and optimize queries for concurrent access.
Manage the data lifecycle including compaction, cold storage migration (S3), and cost optimization.
Lead stress testing (load, concurrency) and document technical designs to support scalability (10x100x growth).

Technical Requirements

Core Skills:

Minimum 4 years of experience in Python for Big Data (Spark/Hadoop); experience with ELK/Elastic Stack is a plus.
At least 2 years of experience in API development (FastAPI/Flask), streaming technologies (Kafka/Spark Streaming), and containerization (Kubernetes).
Strong proficiency in SQL, pandas, numpy, and cloud storage (S3).

Design Skills:

Expertise in system architecture, UML, and API integration.

Flexibility:

Candidates with experience in ELK/Elastic, AWS Kinesis, or similar tools are encouraged to apply if they demonstrate rapid learning ability.

Soft Skills

Strong analytical problem-solving skills for performance and scalability challenges.
Clear and effective communication for documenting architectures and collaborating across teams.
Results-driven mindset with a focus on SLAs and KPIs such as latency, throughput, and data accuracy.

Candidate Profile:

More Jobs at Iridium Cloud Systems

Data Engineer Streaming & APIs

kochi, noida, chennai

INR 10 - 15 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play

App Store

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

Iridium Cloud Systems

RecommendedJobs for You

Data Engineer Streaming & APIs

Iridium Cloud Systems

kochi, noida, chennai

Associate Manager, D&AI BIOps ( Business Intelligence Operations )

hyderabad

Manager Global Trade Services and Analytics role in MNC @ Pune

pune

QuickSight Expert

gurugram

Senior Associate (TAS Data Analytics)

kolkata, bengaluru

Data Engineer Streaming & APIs

Iridium Cloud Systems

kochi, noida, chennai

Data Architect

Massmutual Global Business Services India

hyderabad

Hotel Mapping Analyst

gurugram, sector 39

Business Analyst Intern

Pixelque Software

pune

Azure Data Engineer - Immediate Joiners

Chadwick Professional Services

hyderabad, chennai, bengaluru