Big Data Engineer

Grid Dynamics

7 - 12 years

10 - 20 Lacs

hyderabad

Posted:1 day ago| Platform:

Apply

Skills Required

scala hdfs aws python spark apache spark

Work Mode

Work from Office

Job Type

Full Time

Job Description

Notice Period : Immediate to 30 days

Mandatory

Scala and Python
Apache Spark
(batch & streaming) must!
Deep knowledge of
HDFS internals
and migration strategies.
Experience with
Apache Iceberg
(or similar table formats like Delta Lake / Apache Hudi) for schema evolution, ACID transactions, and time travel.
Running
Spark
and/or
Flink
jobs on
Kubernetes
(e.g., Spark-on-K8s operator, Flink-on-K8s).
Experience with distributed blob storages like Ceph or AWS S3 and similar
Building ingestion, transformation, and enrichment pipelines for large-scale datasets.
Infrastructure-as-Code (Terraform, Helm) for provisioning data infrastructure.
Ability to work independently while guiding juniors.

Nice to have:

Experience with Apache Flink
Prior experience in
migration projects
or large-scale data platform modernization.
Apple experience preferred (to enable him/her to get up to speed on our tooling set quickly and more independently)
Role & responsibilities

Preferred candidate profile

More Jobs at Grid Dynamics

Bid Manager

Hyderabad, Telangana, India

5 - 8 yrs

Salary: Not disclosed

Qa Test Engineer

Hyderabad, Chennai, Bengaluru

5 - 10 yrs

INR 15 - 22 Lacs

Senior Python Developer

Chennai

8 - 13 yrs

INR 20 - 30 Lacs

Technical Delivery Manager- Chennai

Chennai

18 - 25 yrs

INR 30 - 40 Lacs

Junior HRBP

Hyderabad, Telangana, India

7.0 - 7.0 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.