Azure Data Engineer

Responsibilities:

• To design and implement Data pipelines using Azure Synapse from variety of data sources, file formats into SQL Server database

• To implement batch and real time data pipelines from various data sources to data warehouse and data lake

• To work with Data Architect on new Data projects by building Data pipelines, Master Data management

• To perform data analysis, extraction, cleansing, Column-mapping, data transformations and data modelling based on business requirement

• To ensure Data Availability on Azure SQL Datawarehouse by monitoring and troubleshoot Data pipelines

Skillset:

• Must have 3+ years experience in Design, Development of ETL Pipelines in

  Azure Synapse or Azure Data factory

• Must have hands-on experience in related Azure services like

  ADLS2, Databricks, Azure SQL, Logic Apps

• Must have strong implementation knowledge in

  Pyspark and Advanced SQL

  to attain Data transformations

• Must have handled Structured, Semi-structed and unstructured data formats

• Must have clear understanding of Data-warehouse, Data lake modelling & ETL performance optimization

• Good to have working knowledge in consuming APIs in ETL pipelines

• Good to have working knowledge on PowerBI and Manufacturing Data Analytics & Reporting

• Bachelors or masters degree in information technology or Computer Science or related disciplines.