Azure Data Engineer

Job Description

• Minimum 6 years experience within Data Engineering with minimum 2 years in a similar role • Experience with Databrick, DBT, Python and Pyspark is preferrable but not mandatory • Comfortable working within conceptual, logical and physical data model following Data Vault 2.0 and Kimball data modelling methodologies • Strong experience working in Data Warehousing and Data Analytics projects including data acquisition, data transformation, and data migration projects • Strong experience in SQL and Redshift • Experience in developing and optimising data pipelines using control-m and sql • Experience in data migration, building, enhancing and maintaining cloud data warehousing • Experience in performance tuning and optimising databases and SQL queries for analysis and reporting • Ability to rapidly acquire an understanding of complex business problems/requirements to develop solutions and designs, regardless of existing areas of expertise or specialisation • Strong skills and experience in cloud environments, especially AWS • Experience supporting high availability production systems is desirable What you'll do • Implement and maintain Datawarehouse platform and data pipelines suitable for Data Warehousing and reporting use cases • Build data assets that are aligned to IET data strategy and architectural roadmaps • Promote and champion Data Platform and Engineering ways of working via continuous build, continuous integration and continuous delivery • Support detailed solution design, data modelling, estimation and specification process • Promote test driven development and automated unit test frameworks within the teams • Promote and champion DevOps (CI/CD) practices using Bitbucket and Jenkins • Coordination of deployment and release activities for the team • Develop data engineering standards, implementation patterns and how to guides • Challenge the development team on their delivery of quality, unit test coverage and assistance in the creation of development artefacts • Contribute to risk analysis and utilise that information to plan development activities • Identify technical and process improvements that will benefit the business • Optimising code and ensuring we are getting the best out of the Data Platform • Foster a safe, innovative and results driven culture