Manager Data Engineer - AWS Databricks

8 - 13 years

7 - 12 Lacs

Posted:1 month ago| Platform: Naukri logo

Apply

Work Mode

Work from Office

Job Type

Full Time

Job Description

Job Description
We are seeking a seasoned

Data Engineering Manager

with 8+ years of experience to lead and grow our data engineering capabilities. This role demands strong hands-on expertise in

Python, SQL, Spark

, and advanced proficiency in

AWS

and

Databricks

. As a technical leader, you will be responsible for architecting and optimizing scalable data solutions that enable analytics, data science, and business intelligence across the organization.

Key Responsibilities:

  • Lead the design, development, and optimization of scalable and secure data pipelines using

    AWS services

    such as

    Glue, S3, Lambda, EMR

    , and

    Databricks Notebooks

    , Jobs, and Workflows.
  • Oversee the development and maintenance of

    data lakes

    on

    AWS Databricks

    , ensuring performance and scalability.
  • Build and manage robust

    ETL/ELT

    workflows using

    Python

    and

    SQL

    , handling both structured and semi-structured data.
  • Implement distributed data processing solutions using

    Apache Spark

    /

    PySpark

    for large-scale data transformation.
  • Collaborate with cross-functional teams including data scientists, analysts, and product managers to ensure data is accurate, accessible, and well-structured.
  • Enforce best practices for

    data quality, governance, security

    , and

    compliance

    across the entire data ecosystem.
  • Monitor system performance, troubleshoot issues, and drive continuous improvements in data infrastructure.
  • Conduct code reviews, define coding standards, and promote engineering excellence across the team.
  • Mentor and guide junior data engineers, fostering a culture of technical growth and innovation.

Qualifications

Requirements

  • 8+ years of experience in data engineering with proven leadership in managing data projects and teams.
  • Expertise in

    Python, SQL, Spark (PySpark)

    , and experience with

    AWS

    and

    Databricks

    in production environments.
  • Strong understanding of modern data architecture, distributed systems, and cloud-native solutions.
  • Excellent problem-solving, communication, and collaboration skills.
  • Prior experience mentoring team members and contributing to strategic technical decisions is highly desirable.

Mock Interview

Practice Video Interview with JobPe AI

Start Business Intelligence Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Blend360 India logo
Blend360 India

Consulting / Data Analytics

Bangalore

RecommendedJobs for You

Chennai, Tamil Nadu, India

Pune, Maharashtra, India

Pune, Maharashtra, India

Gurugram, Haryana, India