Databricks Data Engineer

Job Title: Databricks Data Engineer

Location:

Experience:

Notice Period:

Job Summary:

Databricks Data Engineer

Key responsibilities:

Develop and maintain: design and build scalable data architectures and pipelines to support analytics and business requirements using the most-appropriate tools, technologies and methodologies as well as documenting those solutions in appropriate documentation solutions.

Monitor and troubleshoot: support stakeholders with data issues, monitor existing solutions to ensure seamless operations and minimal downtime.

Optimise and manage: build with continuous improvement in mind and refactoring of existing solutions to ensure robust data pathways and future proof implementations.

Collaborate: Work with cross-functional teams (inside and outside of DX) and with stakeholders to understand data requirements and deliver appropriate solutions.

Share expertise: serve as a SME for best practices, tools and technologies, providing consultancy for stakeholders and teams alike.

Functional Knowledge:

Deep understanding of key data design principles, and appropriate technologies and languages to be able to implement solutions successfully, for example, medallion design, normalisation, SCDs, data lakes, SQL, Python, Git, DevOps etc.

Experience in working with data, transformation of data, and the systems that can be used to provide that transformation and provision of data to end users (e.g. Azure, Databricks, SQL Server etc.).

Desirable to have exposure to SAP but not essential, also some Power BI/Fabric knowledge would be useful.

Relevant degree and strong knowledge in appropriate design principles.

Desirable to have knowledge of LucidChart/diagramming/documentation methodologies.

Business Expertise:

Awareness of emerging technologies for innovation in the data lake space such as Fabric, Databricks, SAP Datasphere, Iceberg etc.

Some experience working with consumer sales data (e.g. master data, sales, forecast) would be useful.

Experience of multinational organisations, and cross functional/cross-cultural operations in these environments.

Education:

Computer Science, Information Technology, Data Engineering