Azure Data Engineer

Job Description

Responsibilities Data Modelling Design and implement data models including measures and dimensions to support business intelligence and analytical reporting requirements Azure Data Factory Development Create manage and optimize data pipelines in Azure Data Factory to extract transform and load ETL data from various sources into the data warehouse Dimensional Modelling Develop and implement dimensional models for data warehousing ensuring efficient storage and retrieval of data for analytical purposes ETL Processes Build and maintain ETL processes within Azure Data Factory to transform and cleanse data before loading it into the data warehouse Integration with Analytics Services Collaborate with data scientists and analysts to integrate Azure Data Factory with analytics services such as Azure Synapse Analytics Azure Databricks and Power BI Data Quality and Governance Implement data quality checks and governance measures to ensure the accuracy completeness and consistency of data stored in the data warehouse Performance Tuning Monitor and optimize data warehouse performance including query performance and data loading processes to meet performance and scalability requirements Security and Compliance Implement security measures for data access and ensure compliance with data governance policies and regulatory requirements Documentation Create and maintain documentation for data models ETL processes and data warehouse configurations Collaboration Work closely with business analysts data scientists and other stakeholders to understand reporting requirements and deliver effective data solutions Qualifications Bachelor s degree in computer science Information Technology or a related field Strong experience with Azure Data Factory Azure Synapse Analytics and other Azure data services Proficiency in SQL and data querying languages Expertise in dimensional modeling and data warehousing concepts Handson experience with ETL processes and tools Familiarity with analytics and reporting tools such as Power BI Knowledge of cloud computing concepts and services especially within the Microsoft Azure ecosystem Strong problemsolving and troubleshooting skills Certifications such as Microsoft Certified Azure Data Engineer Associate are a plus Preferred Skills MongoDB certification eg MongoDB Certified Database Administrator Experience with MongoDB databases Minimum of 3 years experience as DBA Experience with other NoSQL DB eg CosmoDB DynamoDB Cassandra etc Familiarity with containerization technologies eg Docker Kubernetes Data Modelling Design and implement data models including measures and dimensions to support business intelligence and analytical reporting requirements Azure Data Factory Development Create manage and optimize data pipelines in Azure Data Factory to extract transform and load ETL data from various sources into the data warehouse Dimensional Modelling Develop and implement dimensional models for data warehousing ensuring efficient storage and retrieval of data for analytical purposes ETL Processes Build and maintain ETL processes within Azure Data Factory to transform and cleanse data before loading it into the data warehouse Integration with Analytics Services Collaborate with data scientists and analysts to integrate Azure Data Factory with analytics services such as Azure Synapse Analytics Azure Databricks and Power BI Data Quality and Governance Implement data quality checks and governance measures to ensure the accuracy completeness and consistency of data stored in the data warehouse Performance Tuning Monitor and optimize data warehouse performance including query performance and data loading processes to meet performance and scalability requirements Security and Compliance Implement security measures for data access and ensure compliance with data governance policies and regulatory requirements Documentation Create and maintain documentation for data models ETL processes and data warehouse configurations Collaboration Work closely with business analysts data scientists and other stakeholders to understand reporting requirements and deliver effective data solutions Bachelor s degree in computer science Information Technology or a related field Strong experience with Azure Data Factory Azure Synapse Analytics and other Azure data services Proficiency in SQL and data querying languages Expertise in dimensional modeling and data warehousing concepts Handson experience with ETL processes and tools Familiarity with analytics and reporting tools such as Power BI Knowledge of cloud computing concepts and services especially within the Microsoft Azure ecosystem Strong problemsolving and troubleshooting skills Certifications such as Microsoft Certified Azure Data Engineer Associate are a plus MongoDB certification eg MongoDB Certified Database Administrator Experience with MongoDB databases Minimum of 3 years experience as DBA Experience with other NoSQL DB eg CosmoDB DynamoDB Cassandra etc Familiarity with containerization technologies eg Docker Kubernetes