Sr. Azure Data Engineer

Fragma Data Systems

5 - 10 years

20 - 35 Lacs

bengaluru

Posted:-1 days ago| Platform:

Apply

Skills Required

azure data factory pyspark azure databricks sql

Work Mode

Hybrid

Job Type

Full Time

Job Description

Roles and Responsibilities

Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure Storage solutions.
Collaborate with cross-functional teams to identify business requirements and design scalable data architectures that meet those needs.
Develop complex SQL queries to optimize database performance and troubleshoot issues in Azure Databricks.
Implement data quality checks using PySpark to ensure high-quality data processing.

Desired Candidate Profile

5-10 years of experience as an ADF developer with expertise in building end-to-end data workflows.
Strong understanding of Azure Databricks, including its architecture, features, and best practices.
Proficiency in writing complex SQL queries for querying large datasets stored in Azure Blob Storage or other relational databases.
Experience working with big data technologies such as Hadoop Distributed File System (HDFS), Spark Core (PySpark), etc.

More Jobs at Fragma Data Systems

Talent Acquisition Specialist

Hyderabad

3.0 - 5.0 yrs

INR 2 - 5 Lacs

Lead - Full Stack Developer

Bengaluru

7.0 - 12.0 yrs

INR 25 - 30 Lacs

Software Developer 2

Bengaluru

5.0 - 10.0 yrs

INR 15 - 20 Lacs

Lead - Sr Java Developer ( Must - Angular & NodeJs )

Bengaluru

7.0 - 12.0 yrs

INR 20 - 35 Lacs

Qa Automation Testing Engineer

Bengaluru

5.0 - 10.0 yrs

INR 10 - 20 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.