Azure Data Engineer

Azure Data Engineer

Key Responsibilities

• Azure Data Solution Implementation

  : Lead the

  implementation and migration of data solutions to Azure cloud

  , with a focus on designing and setting up

  Azure Data Lake

  and

  Azure Data Factory

  solutions.

• Data Warehousing & ETL

  : Work extensively with

  Azure DW

  (Data Warehouse) and leverage strong

  U-SQL and Stored Procedure skills

  for data processing and transformation.

• Legacy System Integration

  : Utilize working knowledge in

  SSIS, SSAS, and SSRS

  for integrating with and migrating data from existing SQL Server environments.

• Performance Optimization

  : Apply

  hands-on experience on SQL performance and tuning

  to ensure optimal efficiency and speed of data operations.

• Development Lifecycle & Standards

  : Adhere to and implement best practices for

  development, testing, and deployment

  , ensuring high-quality solutions and following established

  coding standards

  .

• Solution Design & Decision Making

  : Possess the

  ability to understand the overall solution and design components to fit the overall solution

  . Take

  technical decisions and support them with justifications

  .

• Agile Collaboration & Independence

  : Work effectively in an

  Agile manner

  , demonstrating the

  ability to work independently without much guidance

  .

• Professional Conduct

  : Exhibit self-motivation, strong time management skills, results orientation, and excellent presentation, written, and verbal communication skills. Be a good team player with strong interpersonal skills.

Skills

• Knowledge in setting up data lake and data factory solutions

  .
• Experience in

  implementation and migration of data solutions to Azure cloud

  .
• Strong

  U-SQL and Stored Procedure skills

  .
• Working knowledge in

  SSIS, SSAS, SSRS

  .

• Hands-on experience on SQL performance and tuning

  .
• Proficiency in development testing, deployment knowledge, best practices, and coding standards.
• Ability to understand overall solution architecture and design fitting components.
• Strong analytical and decision-making skills with justification.
• Experience working in an

  Agile manner

  .
• Ability to work independently.
• Self-motivated, results-oriented, strong time management skills.
• Excellent presentation, written, and verbal communication skills.
• Good team player with strong interpersonal skills.

Technical Stack Required

• Azure DW

• Azure Data Lake

• Azure Data Factory

• PySpark

• USQL

Nice to Have

• Implementation and migration experience in Hadoop ecosystem

  such as

  Spark, Python, HDFS, and Machine Learning

  .