Databricks Engineer

Patch Infotech Pvt Ltd

5 years

0 Lacs

hyderabad telangana india

Posted:4 days ago| Platform:

Apply

Skills Required

databricks design data etl apache hive querying integration sql extraction analytics reporting learning governance azure aws gcp architecture pyspark hadoop git debugging communication airflow orchestration kafka spark patch

Work Mode

On-site

Job Type

Full Time

Job Description

Responsibilities

Design, develop, and maintain data pipelines and ETL processes using Databricks and PySpark.
Work extensively with Apache Hive for data querying, transformations, and integration with big data systems.
Write and optimise complex SQL queries for data extraction, transformation, and reporting.
Implement data ingestion and transformation workflows across multiple data sources.
Collaborate with data analysts, data scientists, and business teams to deliver reliable and scalable data solutions.
Develop and optimise data models for analytics, reporting, and machine learning use cases.
Ensure data quality, performance, and governance across all data pipelines.
Monitor, troubleshoot, and optimise existing data processes for performance and reliability.
Work with cloud-based data platforms (Azure / AWS / GCP) and integrate Databricks environments.
Document technical designs, data flows, and architecture for ongoing maintenance.

Requirements

5+ years of hands-on experience as a Data Engineer in enterprise-scale data environments.
Databricks - Must Have (Expert Level).
PySpark - Must Have (Expert Level).
SQL (especially for Apache Hive) - Must Have (Expert Level).
Apache Hive - Must Have (Basic Knowledge).
Hadoop - Good to Have.
Data Modelling - Good to Have.
Strong understanding of ETL/ELT pipelines, data warehousing, and distributed computing frameworks.
Familiarity with version control (Git) and CI/CD for data workflows.
Good understanding of cloud data architectures (Azure Data Lake, AWS S3 etc. ).
Excellent problem-solving, debugging, and communication skills.
Experience with Airflow, Azure Data Factory, or similar orchestration tools.
Exposure to machine learning pipelines or real-time data streaming (Kafka, Spark Streaming).
Understanding of data governance, lineage, and cataloguing tools.

This job was posted by Ganesh Singh from Patch Infotech.

More Jobs at Patch Infotech Pvt Ltd

React.js Developer - Next.js/Javascript

Gurugram, Haryana, India

4.5 - 4.5 yrs

Salary: Not disclosed

Java Developer

Gurgaon, Haryana, India

Experience: Not specified

Salary: Not disclosed

Interesting Job Opportunity: Artificial Intelligence/Machine Learning Engineer

Greater Kolkata Area

Experience: Not specified

Salary: Not disclosed

Frontend Developer

Gurugram, Haryana, India

3.0 - 3.0 yrs

Salary: Not disclosed

Node.js Developer - Express.js/NestJS

Bengaluru, Karnataka, India

Experience: Not specified

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.