Azure Data Engineer

Responsibilities:

• Azure Data Solutions Development:

  Design, develop, and maintain scalable and efficient data solutions primarily leveraging

  Azure Databricks

  and

  Azure SQL

  .

• Data Pipeline Construction:

  Build robust ETL/ELT data pipelines using Azure services, ensuring data quality, reliability, and efficient data flow.

• Python Development:

  Utilize

  Python

  for data manipulation, scripting, automation, and building data processing applications.

• Data Modeling & Warehousing:

  Work with data modeling concepts and contribute to the design and implementation of data warehouses and data lakes on Azure.

• Performance Optimization:

  Optimize data processes and queries for performance and cost efficiency within the Azure environment.

• Troubleshooting:

  Identify, troubleshoot, and resolve issues related to data pipelines, data quality, and Azure data services.

• Collaboration:

  Collaborate with data scientists, data analysts, and other stakeholders to understand data requirements and deliver effective data solutions.

• Documentation:

  Create and maintain technical documentation for data pipelines, processes, and solutions.

Required Skills:

• Proficiency in

  Azure Databricks

  .
• Proficiency in

  Azure SQL

  .
• Strong programming skills in

  Python

  .
• Strong understanding of data engineering principles and methodologies.
• Ability to design, develop, and troubleshoot complex data pipelines.
• Knowledge of data warehousing concepts.