Posted:2 days ago| Platform: Linkedin logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Hiring a Data Engineer with 5 to 10 years of experience skilled in Databricks, Spark, ETL, and cloud platforms. The role involves building scalable data pipelines, optimising workflows, and managing end-to-end data processing across AWS, Azure, or GCP. Location is Navi Mumbai or Pune.

Key Responsibilities

  • Design, develop, and maintain data pipelines using Databricks and Apache Spark.
  • Extract, transform, and load (ETL) data from various sources(structured and unstructured) into the Databricks platform.
  • Optimize data pipelines for performance and scalability.
  • Collaborate with data analysts and data scientists to understand data requirements and provide data solutions.
  • Implement data quality checks and monitoring mechanisms.
  • Troubleshoot and resolve data pipeline issues.
  • Stay up-to-date with the latest data engineering technologies and best practices.
  • Participate in code reviews and contribute to documentation to ensure best practices are followed.

Required Skills And Experience

  • Bachelor's degree in Computer Science, Data Science, Engineering, or a related field.
  • 5+ years of experience in data engineering or related fields.
  • Strong proficiency in Python or Scala programming languages.
  • Hands-on experience with Databricks and Apache Spark.
  • Knowledge of SQL and data warehousing concepts.
  • Experience with cloud platforms (AWS, Azure, GCP).
  • Understanding of data modeling and data warehousing principles.
  • Strong problem-solving and analytical skills, with attention to detail.
  • Excellent communication and collaboration skills.
  • Exposure to CI/CD practices in Databricks environments.
  • Basic knowledge of machine learning lifecycle and model deployment on Databricks.
  • Experience with data orchestration tools such as Apache Airflow.
Skills: apache spark,aws,spark,data engineering,gcp,python

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

RecommendedJobs for You

navi mumbai, maharashtra, india

greater kolkata area

hyderabad, telangana

bengaluru, karnataka, india

hyderabad, telangana, india