Azure Data Engineer

Roles and Responsibilities

• Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure storage solutions such as Azure Blob Storage.
  
• Collaborate with cross-functional teams to understand business requirements and design scalable data architectures that meet those needs.
  
• Develop complex SQL queries to optimize database performance and troubleshoot issues in Azure Databricks.
  
• Implement machine learning models using Azure Synapse Analytics for real-time analytics processing.
  
• Ensure high availability of critical systems by implementing monitoring tools like Azure Monitoring.
  

Desired Candidate Profile

• 6-11 years of experience in software development with expertise in cloud computing platforms like Microsoft Azure.
  
• Bachelor's degree in Any Specialization (B.Sc/B.Tech/B.E.).
  
• Strong understanding of big data technologies including Hadoop ecosystem components like Spark Core & Hive.