Senior Data Engineer

Straive

5 - 10 years

25 - 30 Lacs

hyderabad

Posted:21 hours ago| Platform:

Apply

Skills Required

pyspark data pileline scala sql python etl

Work Mode

Hybrid

Job Type

Full Time

Job Description

Job Summary

Senior Data Engineer

Key Responsibilities

Design and build data pipelines using
Apache Spark 3.x, Scala, Python, and SQL
.
Tune Spark jobs for performance and cost.
Ensure code quality with unit tests, CI/CD, and code reviews.
Collaborate with platform and DevOps teams to deploy and monitor pipelines.
Troubleshoot production issues and perform root-cause analysis.

Qualifications

5-8 years of experience as a
Data Engineer
.
Strong hands-on experience with
Apache Spark 3.x
.
Proficient in
Scala, Python, and advanced SQL
.
Experience with
streaming frameworks
(e.g., Spark Structured Streaming, Kafka).
Knowledge of
orchestration tools
(e.g., Apache Airflow).
Experience with cloud platforms like
AWS Glue, EMR, Athena, Redshift, and S3
is a plus.
Solid understanding of
software engineering fundamentals
(Git, CI/CD).
Role & responsibilities

Preferred candidate profile

More Jobs at Straive

Fraud strategy

Bengaluru, Hyderabad, Gurgaon

3 - 8 yrs

INR 15 - 30 Lacs

Data Scientist - Banking

Noida, Gurugram, Bengaluru

3 - 8 yrs

INR 22 - 37 Lacs

Financial Analyst

Puducherry, Chennai

4 - 6 yrs

INR 6 - 6 Lacs

Junior Executive Global Mobility

Chennai, Tamil Nadu, India

Experience: Not specified

Salary: Not disclosed

Rights & Permissions - Clearance specialist

Chennai, Tamil Nadu, India

2 - 5 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.