Senior Data Engineer

EXL

7 years

0 Lacs

hyderabad telangana india

Posted:1 week ago| Platform:

Apply

Skills Required

data aws design redshift engineering analytics learning governance checks monitoring scalability effectiveness pyspark ml workflow orchestration airflow kafka spark terraform security compliance

Work Mode

On-site

Job Type

Full Time

Job Description

Job Summary:

Data Engineer

Key Responsibilities:

Design, develop, and maintain
data pipelines
and workflows using
AWS (S3, Redshift, Glue, EMR, Lambda, Kinesis, Athena)
and
Databricks
.
Leverage
Databricks
for data engineering, advanced analytics, and machine learning workloads.
Collaborate with data scientists, analysts, and stakeholders to deliver reliable and scalable data solutions.
Implement
data governance, quality checks, and monitoring frameworks
.
Ensure high availability, scalability, and cost-effectiveness of data solutions.

Required Skills:

7+ years of experience in
data engineering
.
Strong hands-on experience with
AWS cloud services
(S3, Redshift, Glue, EMR, Athena, Lambda, Kinesis).
Expertise in
Databricks
(PySpark, Delta Lake, ML pipelines).
Proficiency in
Python
and
SQL
for data transformation and querying.
Strong understanding of
data warehousing, data modeling, and big data frameworks
.
Experience with workflow orchestration tools (Airflow, Step Functions).

Preferred Qualifications:

Experience with
real-time/streaming data
(Kafka, Spark Streaming).
Knowledge of
infrastructure as code
(Terraform/CloudFormation).
Exposure to data security, compliance, and governance practices.

More Jobs at EXL

Senior Manager

Gurgaon

7 - 10 yrs

INR 20 - 30 Lacs

GL - Senior Executive

Bengaluru

3 - 6 yrs

INR 3 - 8 Lacs

Executive (Accounts Payable )

Pune

1 - 3 yrs

INR 2 - 3 Lacs

OTC Cash Application - Senior Executive

Bengaluru

1 - 3 yrs

INR 1 - 5 Lacs

OTC Billing - Senior Executive

Bengaluru

1 - 3 yrs

INR 1 - 5 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.