Data Engineer (Databricks)

Affine Analytics

5 - 8 years

15 - 27 Lacs

Hyderabad Gurugram Bengaluru

Posted:1 week ago| Platform:

Apply

Skills Required

Spark-SQL Azure Data Factory Data Engineering ADLS PySpark Azure Databricks Databricks

Work Mode

Hybrid

Job Type

Full Time

Job Description

Design and build data pipelines using Spark-SQL and PySpark in Azure Databricks
Design and build ETL pipelines using ADF
Build and maintain a Lakehouse architecture in ADLS / Databricks.
Perform data preparation tasks including data cleaning, normalization, deduplication, type conversion etc.
Work with DevOps team to deploy solutions in production environments.
Control data processes and take corrective action when errors are identified. Corrective action may include executing a work around process and then identifying the cause and solution for data errors.
Participate as a full member of the global Analytics team, providing solutions for and insights into data related items.
Collaborate with your Data Science and Business Intelligence colleagues across the world to share key learnings, leverage ideas and solutions and to propagate best practices.
You will lead projects that include other team members and participate in projects led by other team members.
Apply change management tools including training, communication and documentation to manage upgrades, changes and data migrations.

Job Requirement

Must Have Skills:

Azure Databricks
Azure Data Factory
PySpark
Spark - SQL
ADLS

More Jobs at Affine Analytics

Consultant - Data Engineer (with Fabric)

Bengaluru

5.0 - 8.0 yrs

INR 15 - 27 Lacs

Consultant - Sr. Power BI Developer

Bengaluru

5.0 - 8.0 yrs

INR 15 - 27 Lacs

Consultant - Data Engineer

Bengaluru

5.0 - 8.0 yrs

INR 15 - 27 Lacs

Consultant - Solution Specialist - AI/ML

Bengaluru

5.0 - 7.0 yrs

INR 15 - 27 Lacs

MLOps Engineer

Bengaluru

4.0 - 8.0 yrs

INR 15 - 27 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.