Home
Jobs

Data Engineer

8 - 13 years

20 - 35 Lacs

Kolkata Pune Bengaluru

Posted:1 month ago| Platform: Naukri logo

AI Match Score
Apply

Skills Required

Pyspark Kafka Streams AWS

Work Mode

Hybrid

Job Type

Full Time

Job Description

Role & responsibilities 8+ years experiences on relevant field below (Internship, prototype, and personal projects won't be counted) Coding is required . (Ideally Python or Java) Own end to end lifecycle (From development to deployment to production environment) Experience in building or deploying solution in the cloud. Either Cloud Native (Serverless) : S3, Lambda, AWS Batch, ECS Or Cloud Agnostic: Kubernetes, Helm Chart, ArgoCD, Prometeus, Grafana. CICD experience: Github action or Jenkin. Infrastructure as code : e.g., Terraform And experience in at least one of this focus area: Big Data: Building Big data pipeline or Platform to process petabytes of data: (PySpark, Hudi, Data Lineage, AWS Glue, AWS EMR, Kafka, Schema Registry) Or GraphDB : Ingesting and consuming data in Graph Database such as Neo4J, AWS Neptune, JanusGraph or DGraph Preferred candidate profile Specifically highlight Kafka expertise - include details like: Experience with Kafka cluster management and configuration Stream processing with Kafka Streams or KSQL Schema Registry implementation and management Kafka Connect for data integration Put significant focus on PySpark skills: Experience building and optimizing PySpark jobs for batch processing Stream processing with Spark Structured Streaming Familiarity with Delta Lake, Hudi, or Iceberg for lakehouse implementation Highlight data engineering skills that complement these technologies: Data pipeline design and implementation Experience with data quality, validation, and lineage tracking Performance optimization for large-scale data processing

More Jobs at Calsoft

Finance Manager

Pune, Maharashtra, India

5 - 8 yrs
|

Salary: Not disclosed

Product Owner

Pune, Maharashtra, India

10 - 10 yrs
|

Salary: Not disclosed

Golang Developer/Lead

Kolkata, Pune, Bengaluru

4 - 9 yrs
|

INR 10 - 20 Lacs

Data Engineer

Kolkata, Pune, Bengaluru

8 - 13 yrs
|

INR 20 - 35 Lacs

Java Automation Professional

Pune, Bengaluru

4 - 8 yrs
|

INR 6 - 10 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Pyspark Interview Now
Calsoft
www.calsoftinc.com/

Information Technology and Services

San Jose

500+ Employees

41 Jobs

    Key People

  • Karthik Raghunath

    President & CEO

  • Ravi Gupta

    Co-Founder & CTO

RecommendedJobs for You

Data Engineer

Moving Walls Sdn Bhd

Chennai

Data Engineer

Amazon

Bengaluru

Data Engineer

LenDenClub

Mumbai

Data Engineer

Wipro

Pune, Chennai, Bengaluru

Data Engineer

Moving Walls Sdn Bhd

Chennai, Malaysia, Malaysia, Kuala Lumpur

Data Engineer

Cynosure Corporate Solutions

Chennai

Data Engineer

Azuga Telematics

Bengaluru

Data Engineer

Ness

Hyderabad

Data Engineer

Align Technology

Hyderabad

Data Engineer

Advanced Energy

Pune