Azure Databricks

Job Title

We are looking for an experienced Azure Databricks Data Engineer with strong hands-on expertise in Azure data services, PySpark, SQL, and DBT. The candidate should have experience in developing data pipelines and handling complex JSON and XML data ingestion.

Key Responsibilities

• Design, develop, and maintain data pipelines using Azure Databricks and Azure Data Factory.
• Work with Azure Data Lake and Azure SQL for data storage, processing, and integration.
• Develop data transformation logic using PySpark, SQL, and DBT.
• Handle complex JSON and XML data ingestion, parsing, and transformation.
• Optimize data processing workflows for performance and scalability.
• Ensure data quality, reliability, and efficient data integration.

Mandatory Skills

• Azure Databricks (ADB)
• Azure Data Factory (ADF)
• Azure Data Lake (ADL)
• Azure SQL (ASQL)
• DBT
• PySpark and SQL
• Complex JSON and XML data ingestion

Candidate Requirements

• 5-8 years of relevant experience in data engineering.
• Strong hands-on experience with Azure data services and data pipeline development.
• Good problem-solving and data transformation skills.

Experience Required: