Manager - Data Engineer - AWS Databricks

Blend360 India

8 - 13 years

35 - 55 Lacs

hyderabad chennai bengaluru

Posted:1 week ago| Platform:

Apply

Skills Required

spark aws databricks aws glue python sql aws lambda etl aws aws emr

Work Mode

Hybrid

Job Type

Full Time

Job Description

Data Engineering

Responsibilities:

Design, develop, and optimize scalable data pipelines using Databricks in
AWS
such as
Glue, S3, Lambda, EMR, Databricks notebooks,
workflows and jobs.
Building data lake in WS Databricks.
Build and maintain robust
ETL/ELT workflows
using
Python
and
SQL
to handle structured and semi-structured data.
Develop distributed data processing solutions using
Apache Spark
or
PySpark
.
Partner with data scientists and analysts to provide high-quality, accessible, and well-structured data.
Ensure data quality, governance, security, and compliance across pipelines and data stores.
Monitor, troubleshoot, and improve the performance of data systems and pipelines.
Participate in code reviews and help establish engineering best practices.
Mentor junior data engineers and support their technical development.

Requirements

Bachelor's or master's degree in computer science, Engineering, or a related field.
8+
years of hands-on experience in
data engineering
, with at least 3 years working with
AWS

Databricks
.
Strong programming skills in
Python
for data processing and automation.
Advanced proficiency in
SQL
for querying and transforming large datasets.
Deep experience with
Apache Spark/PySpark
in a distributed computing environment.
Solid understanding of data modelling, warehousing, and performance optimization techniques.
Proficiency with AWS services such as
Glue
,
S3
,
Lambda
and
EMR
.
Experience with version control Git or Code commit
Experience in any workflow orchestration like Airflow, AWS Step functions is a plus.
Excellent communication and stakeholder management skills with a strategic mindset.

More Jobs at Blend360 India

Senior Data Scientist - Forecasting

Hyderabad

5 - 7 yrs

INR 20 - 27 Lacs

Lead Data Engineer

Hyderabad

5 - 10 yrs

INR 15 - 30 Lacs

Lead Azure DevOps Engineer

Hyderabad

7 - 12 yrs

INR 15 - 25 Lacs

Lead Azure Data Engineer

Hyderabad

6 - 11 yrs

INR 15 - 25 Lacs

Senior AWS Data Engineer

Hyderabad

5 - 10 yrs

INR 15 - 30 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.