Data Engineer

POSITION OVERVIEW:

Data Engineer

KEY ROLES & RESPONSIBILITIES :

Spearhead the design, development, deployment, testing, and management of strategic data architecture, leveraging cutting-edge technology stacks on cloud, on-prem and hybrid environments

Design and implement an end-to-end data architecture within Microsoft Fabric / SQL, including Azure Synapse Analytics (incl. Data warehousing). This would also encompass a Data Mesh Architecture.

Develop and manage robust data pipelines to extract, load, and transform data from SAP systems (e.g., ECC, S/4HANA, BW).

Perform data modeling and schema design for enterprise data warehouses in Microsoft Fabric.

Ensure data quality, security, and compliance standards are met throughout the data lifecycle.

Enforce Data Security measures, strategies, protocols, and technologies ensuring adherence to security and compliance requirements

Collaborate with BI, analytics, and business teams to understand data requirements and deliver trusted datasets.

Monitor and optimize performance of data processes and infrastructure.

Document technical solutions and develop reusable frameworks and tools for data ingestion and transformation.

Establish and maintain robust knowledge management structures, encompassing Data Architecture, Data Policies, Platform Usage Policies, Development Rules, and more, ensuring adherence to best practices, regulatory compliance, and optimization across all data processes

Implement microservices, APIs and event-driven architecture to enable agility and scalability.

Create and maintain architectural documentation, diagrams, policies, standards, conventions, rules and frameworks to effective knowledge sharing and handover.

Monitor and optimize the performance, scalability, and reliability of the data architecture and pipelines.

Track data consumption and usage patterns to ensure that infrastructure investment is effectively leveraged through automated alert-driven tracking.

KEY COMPETENCIES:

Microsoft Certified: Fabric Analytics Engineer Associate or equivalent certificate for MS SQL.

Prior experience working in cloud environments (Azure preferred).

Understanding of SAP data structures and SAP integration tools like SAP Data Services, SAP Landscape Transformation (SLT), or RFC/BAPI connectors.

Experience with DevOps practices and version control (e.g., Git).

Deep understanding of SAP architecture, data models, security principles, and platform best practices.

Strong analytical skills with the ability to translate business needs into technical solutions.

Experience with project coordination, vendor management, and Agile or hybrid project delivery methodologies.

Excellent communication, stakeholder management, and documentation skills.

Strong understanding of data warehouse architecture and dimensional modeling.

Excellent problem-solving and communication skills.

QUALIFICATIONS / EXPERIENCE / SKILLS Qualifications

Bachelors degree in Computer Science, Information Systems, or a related field.

Certifications such as SQL, Administrator, Advanced Administrator, are preferred.

Expertise in data transformation using SQL, PySpark, and/or other ETL tools.

Strong knowledge of data governance, security, and lineage in enterprise environments.

Advanced knowledge in SQL, database procedures/packages and dimensional modeling

Proficiency in Python, and/or Data Analysis Expressions (DAX) (Preferred, not mandatory)

Familiarity with PowerBI for downstream reporting (Preferred, not mandatory).

Experience

Skills:

Hands-on experience with Microsoft SQL (MS-SQL), Microsoft Fabric including Synapse (Data Warehousing, Notebooks, Spark)

Experience integrating and extracting data from SAP systems, such as: o SAP ECC or S/4HANA

SAP BW o SAP Core Data Services (CDS) Views or OData Services

Knowledge of Data Protection laws across countries (Preferred, not mandatory)