Senior Data Engineer

EXL

7 - 9 years

0 Lacs

hyderabad telangana india

Posted:17 hours ago| Platform: Foundit logo

Apply

Skills Required

airflow step functions aws cloud services ml pipelines glue delta lake athena big data frameworks

Work Mode

On-site

Job Type

Full Time

Job Description

Job Summary:

Data Engineer

Key Responsibilities:

Design, develop, and maintain
data pipelines
and workflows using
AWS (S3, Redshift, Glue, EMR, Lambda, Kinesis, Athena)
and
Databricks
.
Build and optimize
ETL/ELT processes
for large-scale structured and unstructured datasets.
Leverage
Databricks
for data engineering, advanced analytics, and machine learning workloads.
Collaborate with data scientists, analysts, and stakeholders to deliver reliable and scalable data solutions.
Implement
data governance, quality checks, and monitoring frameworks
.
Ensure high availability, scalability, and cost-effectiveness of data solutions.

Required Skills:

7+ years of experience in
data engineering
.
Strong hands-on experience with
AWS cloud services
(S3, Redshift, Glue, EMR, Athena, Lambda, Kinesis).
Expertise in
Databricks
(PySpark, Delta Lake, ML pipelines).
Proficiency in
Python
and
SQL
for data transformation and querying.
Strong understanding of
data warehousing, data modeling, and big data frameworks
.
Experience with workflow orchestration tools (Airflow, Step Functions).

Preferred Qualifications:

Familiarity with
MLOps/ML integration
within Databricks.
Experience with
real-time/streaming data
(Kafka, Spark Streaming).
Knowledge of
infrastructure as code
(Terraform/CloudFormation).
Exposure to data security, compliance, and governance practices.

More Jobs at EXL

Senior Manager

Gurgaon

7 - 10 yrs

INR 20 - 30 Lacs

GL - Senior Executive

Bengaluru

3 - 6 yrs

INR 3 - 8 Lacs

Executive (Accounts Payable )

Pune

1 - 3 yrs

INR 2 - 3 Lacs

OTC Cash Application - Senior Executive

Bengaluru

1 - 3 yrs

INR 1 - 5 Lacs

OTC Billing - Senior Executive

Bengaluru

1 - 3 yrs

INR 1 - 5 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.