Azure Data Engineer - PAN India - Hybrid (6-14 Yrs)

"Azure Data Engineer"

Job type:- Permanent / Full Time

1) Skills - Pyspark + ADB, ADF - Good to have

Exp - 6-9 yrs

Loc - Chennai/Mumbai (Hybrid)

NP - Sept Serving Only

IP - L1 - L2 - Virtual

2) Skills - Pyspark + ADB + ADF + SQL, Azure Synapse - Good to have

Exp - 6-14 yrs

Loc - MPCBN - Hybrid (Coim/Ahm - 2nd priority)

NP - Sept Serving Only

IP - L1 - L2 - Virtual

3) Skills - Pyspark + Azure Synapse - SQL

G5 - 6-12 yrs

Loc - MPCB - Hybrid

NP - Mid Sept Serving Only

IP - L1 - L2 - Virtual

• 6+ years of experience in ETL with minimum of 3+ years of experience in PySpark/Spark SQL
• Strong SQL skills with experience in Azure SQL & Synapse
• Strong Skill in developing Synapse Notebooks , Azure Data Bricks
• Experience in ETL (SAS/Informatica/ADF Data flows)
• Experience implementing Synapse Pipelines/Dataflows
• Use the interactive Synapse/Databricks notebook environment using SQL, Examine external data sets, Query existing data sets using SQL
• ETL transformations and Loads using Synapse Notebooks/ Azure Databricks to apply built-in functions to manipulate data,
• Perform an ETL job on a streaming data source, Parameterize a code base and manage task dependencies, Submit and monitor jobs using the REST API or Command Line Interface
• Manage Delta lake using interactive Synapse notebook environment, Create, append and upsert data into a data lake. Primary Responsibilities
• Develop ETL processing and Data extraction using Synapse Notebooks / Azure Databricks.
• Develop Apache Spark SQL using Python to examine and query datasets.
• Develop Dataframes for ETL transformation and loads
• Capture audit information during all phases of the ETL transformation process.
• Write and maintain documentation of the ETL processes via process flow diagrams.
• Collaborate with business users, support team members, and other developers throughout the organization to help everyone understand issues that affect the data warehouse.

Any references would be greatly appreciated !!

Cheers & warm regards,

Kajal Gupta

Lead - Talent Acquisition Specialist

kajal.gupta@prodcon.com