Databricks Engineer

5 - 8 years

Bengaluru east

Posted:10 hours ago

Job Description

  • 5-8 years of experience in Data Engineering and Big Data technologies.
  • Strong hands-on experience with Databricks, PySpark, and Spark SQL.
  • Experience with Delta Lake, Databricks Workflows, and Unity Catalog.
  • Proficiency in Python and SQL.
  • Experience with Azure/AWS/GCP cloud platforms.
  • Knowledge of Azure Data Factory (ADF), Apache Airflow, or similar orchestration tools.
  • Understanding of data warehousing concepts and ETL/ELT methodologies.
  • Experience with Kafka/Event Hub for streaming data processing is preferred.
  • Familiarity with Git, CI/CD pipelines, and DevOps practices.
  • Strong problem-solving, analytical, and communication skills.
Roles & Responsibilities Design, develop, and maintain data pipelines using Databricks. Build ETL/ELT workflows for large-scale data processing. Develop and optimize data transformation logic using PySpark and Spark SQL. Implement and manage Delta Lake for reliable and efficient data storage. Work with batch and real-time data ingestion frameworks. Monitor and optimize data pipelines for performance and scalability. Collaborate with data analysts, data scientists, and business stakeholders. Ensure data quality, security, and governance standards are followed. Troubleshoot production issues and provide ongoing support.

Skills Required

Data Engineering BIG Data Technologies Pyspark Spark SQL Python Azure AWS GCP Cloud Azure Data Factory Apache Data Warehousing Concepts

Learn the skills this job asks for

See your skill gap for Data Engineer →

Free courses, interview questions and practice for each skill.

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
Infosys logo
Infosys

IT Services and IT Consulting

Bangalore Karnataka

RecommendedJobs for You

Qentelli logo

Hyderabad

Bridgenext logo

Pune

Bridgenext Digital Engineering logo

Databricks Engineer

Bridgenext Digital Engineering

Pune

KPI Partners logo

Hyderabad, Pune, Bengaluru

Qentelli logo

Hyderabad

Bridgenext logo

Pune

Bridgenext Digital Engineering logo

Databricks Engineer

Bridgenext Digital Engineering

Pune