Azure Data Engineer

Role & responsibilities

Designing and developing data products in the Microsoft Azure stack such as Azure Data Factory, Databricks, Azure DevOps deployment pipelines, Airflow, et cetera • Creating scalable data products to boost data-driven working Leading in one or more initiatives within the area D&I to enable, facilitate and operationalize innovation to be at the forefront of technological developments. • Work together with other lead engineers at area level to set the foundations and best practices. • Ensure that other engineers can proactively identify gaps in information, manage limitations, and consider the broader implications of their decisions. • 7+ years experience as a Data Engineer in a complex IT landscape • Experience in Azure Data Bricks Knowledge , Splunk , Dynatrace , Pyspark, AWS /Azure Devops CI/CD, Airflow , Specflow , • Experience in working with SQL and developing ETL solutions Experienced in working with Azure data platform. For example, ADF, Databricks, Synapse, Azure DevOps • Experienced in testing pipelines which are built on Azure with system and regression tests • Experienced with OPS work like monitoring and solving incidents • Knowledge of Apache Airflow • Knowledge of data modelling and data management is preferable • Knowledge of Python Spark is preferable • Knowledge of client and payments data is preferable • AWS knwoledge/certification is must.