Data Engineer: Data Platforms (Databricks)

Data Engineer – Data Platforms (Databricks)

Location: Bengaluru
Experience: 5+ Years
Interview Mode: Online
Job Type: Full-time

Job Overview

We are looking for an experienced Data Engineer with strong hands-on expertise in Databricks and modern data engineering platforms. The candidate will be responsible for designing, developing and maintaining scalable data pipelines, implementing ETL/ELT processes and optimising data platforms for efficient data processing.

Responsibilities

• Design, develop and maintain scalable data pipelines using Databricks.
• Develop data processing solutions using Python, PySpark and SQL.
• Build and optimise ETL/ELT pipelines for data ingestion and transformation.
• Work with Delta Lake and Lakehouse architecture.
• Develop and manage data workflows using Databricks Workflows.
• Perform data modelling, data transformation and data integration.
• Ensure data quality, consistency, security and governance.
• Monitor, troubleshoot and optimise data pipelines.
• Collaborate with data architects, analysts and cross-functional engineering teams.
• Implement CI/CD practices for data engineering workflows.

Required Qualifications and Skills

• 5+ years of overall experience in Data Engineering.
• Strong hands-on experience with Databricks.
• Proficiency in Python, PySpark and SQL.
• Strong understanding of Apache Spark and distributed data processing.
• Experience with Delta Lake and Lakehouse architecture.
• Hands-on experience in developing ETL/ELT pipelines.
• Knowledge of data warehousing and data modelling concepts.
• Experience with cloud platforms such as Azure, AWS or GCP.
• Understanding of data governance and data quality practices.

Preferred Skills

• Experience with Databricks Unity Catalog.
• Knowledge of Delta Live Tables (DLT).
• Experience with Azure Data Factory, Apache Airflow or similar orchestration tools.
• Familiarity with Git, CI/CD and DevOps practices.
• Experience with real-time data processing and streaming technologies.

Interview Process

• Online interview.
• Technical evaluation followed by further discussion.

Application Requirements

Interested candidates are requested to apply with their updated resumes and mention their current CTC, expected CTC and notice period.

Pay: From ₹1,000,000.00 per year

Work Location: In person