Lead Data Engineer (Databricks)

SII Group India

0 years

0 Lacs

noida uttar pradesh india

Posted:6 days ago| Platform:

Apply

Skills Required

data databricks pyspark support analytics reporting design etl unity governance gcp engineering security devops coding optimization writing deployment git agile

Work Mode

On-site

Job Type

Full Time

Job Description

About the Role

Data Engineer

Key Responsibilities

Design, build, and optimize scalable data pipelines and ETL processes using
Databricks
and
PySpark
.
Implement and manage
Unity Catalog
for data governance, lineage, and access control.
Develop and maintain
infrastructure as code
using
Terraform
for GCP services.
Create and manage
CI/CD pipelines
for data engineering workflows.
Work with
GCP Services
such as
Cloud Build, BigQuery, Firestore
, and other related tools.
Ensure high data quality, security, and availability across all data platforms.
Collaborate with cross-functional teams including data scientists, analysts, and DevOps engineers.
Troubleshoot data-related issues and optimize performance.

Required Skills

Databricks
– Expert hands-on experience
Unity Catalog
– Strong understanding and implementation knowledge
PySpark
– Advanced coding and optimization skills
SQL
– Proficient in writing complex queries and performance tuning
Terraform
– Experience in automating infrastructure deployments
CI/CD
– Proficient in setting up automated build and deployment pipelines
GCP Services
– Hands-on experience with
Cloud Build, BigQuery, Firestore
, etc.

Good to Have

Knowledge of Git and Agile methodologies

More Jobs at SII Group India

Senior Software Engineer[Fullstack]

Noida, Uttar Pradesh, India

5.0 - 5.0 yrs

Salary: Not disclosed

Embedded testing with Python

karnataka

3.0 - 7.0 yrs

INR 0 - 0 Lacs

International Project Manager

noida, uttar pradesh, india

5.0 - 5.0 yrs

Salary: Not disclosed

International Project Manager

bengaluru, karnataka, india

5.0 - 5.0 yrs

Salary: Not disclosed

Application Production Support

chennai, tamil nadu, india

Experience: Not specified

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.