We’re Hiring: PySpark Developer (Databricks)

5 - 8 years

1 - 18 Lacs

Posted:3 days ago| Platform: Foundit logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

We're Hiring: PySpark Developer (Databricks)

  • Experience:

    4+ Years in Data Engineering / Distributed Systems
  • Location:

    Offshore (Sompo IT Systems Development Unit)
  • Joiners:

    Immediate
  • Budget:

    Competitive

Role Summary:

Design, build, and optimize large-scale data pipelines on Databricks Unified Analytics Platform, leveraging PySpark, big data frameworks, and cloud solutions to support advanced analytics and machine learning workflows.

Key Responsibilities:

  • Develop & manage scalable ETL/ELT pipelines using PySpark on Databricks.
  • Optimize data pipelines for performance, scalability & cost.
  • Deploy & manage Databricks on Azure (ADF, Delta Lake, SQL).
  • Build CI/CD pipelines (Azure DevOps / GitHub Actions / Jenkins).
  • Collaborate with cross-functional teams to deliver robust data solutions.

Technical Skills:

  • Python, PySpark, Databricks (Lakehouse, Delta Lake, Databricks SQL).
  • Azure Cloud (Data Lake, Synapse), Hadoop, Spark, Kafka.
  • SQL & NoSQL databases (PostgreSQL, SQL Server, MongoDB, Cosmos DB).
  • Familiarity with MLflow, Kubernetes (added advantage).

General Skills:

  • Strong problem-solving & analytical mindset.
  • Excellent communication & organizational skills.
  • Experience in regulated industries (insurance) preferred.

Education & Certifications:

  • Bachelor's in CS, Data Engineering, or related field.
  • Databricks, PySpark, or cloud certifications highly desirable.

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

RecommendedJobs for You