Data Warehouse Engineer

Role purpose

This is an exciting opportunity for an experienced developer of large-scale data solutions. You will join a team delivering a transformative cloud hosted data platform for a key Version 1 customer.

The ideal candidate will have a proven track record as a senior/self-starting data engineer in implementing data ingestion and transformation pipelines for large scale organisations. We are seeking someone with deep technical skills in a variety of technologies, Azure Data Factory, Azure Synapse Analytics, and SQL Server, to play an important role in developing and delivering early proofs of concept and production implementation.

You will ideally have experience in building solutions using a variety of tools, and a proven track record in delivering high quality work to tight deadlines.

Key responsibilities

Design, develop, and maintain scalable data warehouse solutions Azure Synapse Analytics to support enterprise-level analytics and reporting needs.

Core responsibilities include building efficient Extract, Transform, Load (ETL) or Extract, Load, Transform (ELT) pipelines using Azure Data Factory conducting thorough data validation to ensure accuracy and consistency, and providing support for Business Intelligence (BI) reporting initiatives.

Strong proficiency in SQL is required for querying and data manipulation, along with experience in dimensional data modelling to optimize analytical performance.

Familiarity with reporting and visualization tools such as Power BI or Tableau is essential.

Developing scalable and re-usable frameworks for ingestion and transformation of large data sets

Integrating the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is maintained at all times

Working with other members of the project team to support delivery of additional project components (Reporting tools, API interfaces, Search)

Evaluating the performance and applicability of multiple tools against customer requirements

Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.

Essential experience & skills

Bachelors or master's degree in computer science, Business Information Systems, Mathematics, or related quantitative field

3+ years of experience in DWH implementation

Direct experience of building data piplines using Azure Data Factory

Experience building data warehouse solutions using Azure Synapse Analytics.

Candidates must possess hands-on experience with Structured Query Language (SQL), data quality management tools, and should be proficient in facilitating data exchange through Application Programming Interfaces (APIs).

Strong hands-on experience with SQL Server, advanced SQL query optimization, and relational database concepts.

Proficiency in the data concepts related to curation, archival, analysis, visualization and integrity

Comprehensive understanding of data management best practices including demonstrated experience with data profiling, sourcing, and cleansing routines utilizing typical data quality functions involving standardization, transformation, rationalization, linking and matching.

Strong analytical, critical-thinking, and problem-solving skills

Excellent communication skills and team-oriented approach

Desired Skills

Good knowledge in at least one business intelligence solution (e.g., Power BI)

Additional knowledge of data governance principles and metadata management practices is considered a valuable asset.