AWS Databricks Developer

6 - 10 years

10 - 12 Lacs

Posted:4 days ago| Platform: Naukri logo

Apply

Work Mode

Hybrid

Job Type

Full Time

Job Description

Role & responsibilities

  • Overall, 6 to 8 years of experience in IT Industry. Min 6 years of experience working on Data Engineering.
  • Design and develop solution in combination of Cloudera, Palantir and Databricks.
  • Develop Python-based automation scripts to optimize workflows and processes.
  • Integrate Databricks with AWS ecosystem components such as S3, Glue, Athena, Redshift, and Lambda
  • Define architecture for data-driven solutions.
  • Provide solutioning for web applications and data pipelines.
  • Solutioning data analytics requirements with Palantir.
  • Stay updated with emerging technologies and quickly adapt to new tools and frameworks.
  • Work with CI/CD pipelines.
  • Ensure scalability, security, and performance of deployed solutions.

Collaborate with business teams, data engineers, and developers to align solutions with business goals.

Mandatory Skills:

  • Databricks

    :
    • Expertise in design jobs and workloads.
    • Proficiency in pyspark / scala for data manipulation, transformation and analysis
    • Optimization of Databricks clusters and notebooks.
  • Python

    : Hands-on experience in automation and scripting.
  • Cloudera

    : Strong knowledge of

    Spark, Hive, Impala, HDFS, Kafa, HBase and Cluster management

    .
  • Palantir:

    Hands on experience with

    analytics, data fusion and developing analytical workflows

  • DevOps Basics

    : Familiarity with

    Jenkins

    CI/CD pipelines

    .
  • Integrate Databricks with AWS ecosystem components such as S3, Glue, Athena, Redshift, and Lambda
  • Communication

    : Excellent verbal and written communication skills.
  • Fast Learner

    : Ability to quickly grasp new technologies and adapt to changing requirements.

Responsible Area

  • Job Summary: We are seeking an experienced

    AWS Databricks Developer

    to design, develop, and maintain scalable data processing and analytics solutions on the

    AWS and Databricks

    platform. The ideal candidate will have strong expertise in building data pipelines, optimizing performance, and integrating multiple AWS services to deliver high-quality data solutions.

Preferred candidate profile

Good to have skills:

  • Familiarity with containerization technologies (Docker, Kubernetes).
  • Experience with real-time streaming technologies (e.g., Kafka Streams, Spark Streaming).
  • Exposure to machine learning operationalization (MLOps) workflows.
  • Background in regulated industries with strict data compliance requirements.

Additional Information:

Certifications: Databricks Certified Associate

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You

pune, bengaluru, mumbai (all areas)

kolkata, chennai, coimbatore