Azure Data Engineer

Job Description

KEY ACCOUNTABILITIES/DELIVERABLES Design and implement data pipelines using Azure Data Factory (ADF) and Azure Functions and Logic apps. Design and develop traditional data warehouses from start to finish, including data modelling (star and snowflake schemas), ETL processes, and reporting frameworks. Develop and optimize data storage solutions in Snowflake and manage SQL databases. Manage API integrations using Azure API Management for data consumption. Implement CI/CD pipelines using Azure DevOps. Ensure compliance with security standards and geo-location requirements. Collaborate with cross-functional teams to gather and adapt to evolving requirements. Develop scripts and solutions using Python for automation and data processing. Key skills Expertise in Azure Data Factory, Snowflake, and Databricks. Strong SQL skills for querying, optimization, and ETL tasks. Proficiency in Azure Functions, Logic Apps, and Azure API Management. Strong Python programming for data engineering tasks. Knowledge of CI/CD processes using Azure DevOps. Understanding of data security principles and Geo-location compliance. Preferred Qualifications: Knowledge of Insurance/Re insurance Certified Azure data engineer Prior experience of Geospatial data Demonstrated ability to handle dynamic requirements in a fast-paced environment. Knowledge of data governance and classification practices. Strong problem-solving skills and ability to work independently.