Azure Data Engineer

Senior Azure Data Engineer

Experience:

Location:

Senior Azure Data Engineer

Key Responsibilities

• Provide technical expertise in

  Azure Databricks and Azure Data Factory

  for solution design and implementation.
• Design, develop, unit test, review, and enhance data platforms and pipelines.
• Build and maintain infrastructure for data products, including data pipelines, storage systems, and processing engines.
• Develop data ingestion, curation, and transformation solutions using Spark.
• Ensure adherence to sound architecture and engineering best practices.
• Optimize data infrastructure for scalability, reliability, performance, and resource utilization.
• Minimize downtime and improve the overall efficiency of data platforms.
• Collaborate with Data Architects and Domain Data Stewards to implement solutions aligned with business requirements and Data Mesh principles.

Mandatory Skills

• Minimum 5

  years of experience

  implementing projects using Azure technologies.
• Strong hands-on experience with

  Azure Databricks and Azure Data Factory

  .
• Experience with

  Azure SQL Database, Azure SQL Data Warehouse, and Azure Synapse Analytics

  .
• Proficiency in

  Python and PySpark

  .
• Strong experience in data ingestion, data curation, and transformation using Spark.
• Knowledge of data pipelines, storage systems, processing engines, and cloud-based data architecture.

Preferred Competencies

• Excellent verbal and written communication skills.
• Strong interpersonal and collaboration skills.
• Ability to work independently and within a team environment.
• Strong analytical and problem-solving capabilities.