Azure Data Factory Developer

Mindpool Technologies

6 - 10 years

15 - 30 Lacs

kochi thiruvananthapuram

Posted:13 hours ago| Platform:

Apply

Skills Required

azure data factory pyspark azure azure data lake etl development azure synapse python azure synapse analytics azure databricks azure blob storage azure services

Work Mode

Hybrid

Job Type

Full Time

Job Description

Role & responsibilities

Develop and manage
ETL workflows
using
Azure Data Factory (ADF)
.
Design and implement
data pipelines
using
PySpark on Azure Databricks
.
Work with
Azure Synapse Analytics, Azure Data Lake, and Azure Blob Storage
for data ingestion and transformation.
Optimize
Spark jobs
for performance and scalability in
Databricks
.
Automate
data workflows
and implement
error handling & monitoring
in ADF.
Collaborate with
data engineers, analysts, and business teams
to understand data requirements.
Implement
data governance, security, and compliance
best practices in Azure.
Debug and troubleshoot
PySpark scripts and ADF pipeline failures
.
4+ years
of experience in
ETL development
with
Azure Data Factory (ADF)
.
Hands-on experience with
Azure Databricks
and
PySpark
for
big data processing
.
Strong knowledge of
Azure services
Proficiency in
Python
and
PySpark
for data transformation and processing.
Experience with
CI/CD pipelines
for deploying ADF pipelines and Databricks notebooks.
Strong expertise in
SQL
for data extraction and transformations.
Knowledge of
performance tuning in Spark
and
cost optimization on Azure
.

More Jobs at Mindpool Technologies

Hyperion Essbase and Planning consultant

Pune

5 - 10 yrs

INR 9 - 18 Lacs

Rcm Manager

Pune

9.0 - 14.0 yrs

INR 8 - 18 Lacs

RCM AR Specialist

Pune

1.0 - 5.0 yrs

INR 1 - 6 Lacs

RCM Operations Support Team Lead

Pune

3.0 - 8.0 yrs

INR 5 - 12 Lacs

Senior It Recruiter

Bengaluru

4.0 - 7.0 yrs

INR 3 - 6 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.