Home
Jobs

Python Databricks Developer

6 years

0 Lacs

Posted:6 days ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Job Title:

Location:

Experience:

Employment Type:


Job Summary:

Python Databricks Developer

Key Responsibilities:

  • Design and develop scalable

    ETL pipelines

    and

    data workflows

    using

    Databricks (PySpark)

    and

    Python

    .
  • Work on large-scale data ingestion, processing, and transformation from various sources.
  • Leverage

    AWS services

    (e.g., S3, Glue, Lambda, Redshift, EMR) for data storage, orchestration, and compute.
  • Optimize performance of Spark jobs and Databricks notebooks for large-scale data operations.
  • Collaborate with data architects, analysts, and business stakeholders to deliver robust data solutions.
  • Implement best practices for data quality, data governance, and security.
  • Participate in code reviews, testing, and deployment of data solutions in DevOps-driven environments.
  • Create and maintain technical documentation, data dictionaries, and process flows.

Required Skills & Experience:

  • Strong hands-on programming experience in

    Python

    .
  • Minimum 4+ years of experience working with

    Databricks

    , especially with

    PySpark

    and

    Delta Lake

    .
  • Experience in building and managing data pipelines and ETL processes in

    cloud environments

    , particularly

    AWS

    .
  • Solid understanding of distributed computing concepts and

    Spark

    performance optimization.
  • Hands-on experience with

    AWS services

    such as

    S3, Glue, Lambda, Redshift, Athena, CloudWatch

    , etc.
  • Experience with version control (e.g., Git), CI/CD tools, and workflow orchestration tools like

    Airflow

    or

    Databricks Jobs

    .
  • Knowledge of data modeling, data warehousing, and data lake architectures.
  • Strong problem-solving skills and the ability to work independently or in a team.

Preferred Qualifications:

  • Bachelor's or Master’s degree in Computer Science, Information Technology, or related field.
  • Certification in

    AWS

    or

    Databricks

    is a plus.
  • Experience working in Agile environments with Jira or similar tools.
  • Familiarity with

    SQL

    and NoSQL databases is a plus.

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview Now
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You