Databricks Developer

Job Title: Databricks Developer

Notice Period: Immediate to 15 Days

Location: Pan India (Remote)

Experiences: 5 to 9 Years

Job Summary

Databricks Developer

Roles and Responsibilities

• Design, develop, and maintain

  data pipelines

  using

  Databricks, PySpark, and SQL

  .
• Implement

  ETL/ELT solutions

  for large-scale structured and unstructured datasets.
• Build and optimize

  data workflows

  leveraging

  Airflow

  for orchestration.
• Design and develop

  RESTful APIs

  for data integration and consumption.
• Collaborate with stakeholders to understand business requirements and translate them into technical solutions.
• Ensure performance tuning, data quality, and reliability across pipelines.
• Work with

  Azure cloud services

  (e.g., Data Lake, Synapse, Key Vault, Event Hub) to build scalable solutions.
• Implement

  CI/CD pipelines

  and follow best practices in code management and deployment.
• Troubleshoot, debug, and optimize workflows to improve efficiency and reduce costs.
• Document processes, design decisions, and solutions for future reference.

Required Skills & Experience

• 3–7 years

  of hands-on experience as a

  Data Engineer / Databricks Developer

  .
• Strong expertise in

  Databricks, PySpark, and SQL

  for data processing and transformation.
• Proficiency in

  Python programming

  for data engineering and automation tasks.
• Experience with

  Airflow

  (or similar orchestration tools) for scheduling and monitoring pipelines.
• Solid understanding of

  API design and development

  (REST/GraphQL).
• Proven experience with

  Azure Cloud

  data services (Azure Data Lake, Synapse, Data Factory, Event Hub).
• Strong knowledge of

  data modeling, performance tuning, and optimization techniques

  .
• Familiarity with

  DevOps practices, CI/CD, Git, and containerization (Docker/Kubernetes)

  is a plus.
• Excellent problem-solving skills and ability to work in a fast-paced environment.
• Strong communication and collaboration skills to work with both technical and non-technical stakeholders.