Purpose of the Role The Azure Data & Integration Architect will lead enterprise-wide data and integration initiatives, leveraging Microsoft Azure and Databricks to drive digital transformation, operational efficiency, and data-driven decision-making. This role focuses on architecting scalable data pipelines, designing a unified lakehouse platform, enabling advanced analytics, and integrating enterprise systems across SAP and non-SAP landscapes.
Key Responsibilities
Data Architecture & Analytics
- Architect and implement scalable ELT/ETL pipelines using Azure Data Factory (ADF).
- Develop and optimize data processing and analytics workflows in Azure Databricks using PySpark and Delta Lake.
- Implement Delta Live Tables, Unity Catalog, and Azure Purview for governance, data lineage, and access control.
- Design and deploy enterprise data models and analytical layers using Azure Synapse Analytics.
- Enable enterprise reporting and self-service analytics through Power BI integration.
- Manage both structured and unstructured data using Azure Blob Storage and Azure Data Lake Storage Gen2.
- Collaborate with data scientists and business teams to enable machine learning and predictive analytics use cases.
- Define and enforce data architecture standards, naming conventions, and performance best practices.
Integration & Enterprise Connectivity
- Design and implement integrations between SAP and non-SAP systems using SAP CPI, Azure API Management, and REST/SOAP APIs.
- Ensure secure and scalable data flow across on-premises, cloud, and hybrid environments.
- Implement API authentication and security protocols (OAuth 2.0, JWT, SAML).
- Integrate enterprise applications with Azure Entra ID for identity and access management.
- Establish reusable integration patterns and frameworks for enterprise-wide adoption.
Governance, Security & Compliance
- Ensure data quality, lineage, and governance across the analytics ecosystem.
- Implement security and compliance controls aligned with GxP, 21 CFR Part 11, and corporate IT policies.
- Monitor cost and performance optimization across Azure services.
- Oversee DevOps and CI/CD pipelines for automated deployment and testing using Azure DevOps.
Leadership & Collaboration
- Collaborate closely with cross-functional IT, data, and business teams.
- Conduct technical design reviews, mentor developers, and ensure adherence to architectural standards.
- Support vendor evaluations, solution assessments, and proof-of-concept initiatives.
- Communicate complex technical concepts effectively to senior management and business stakeholders.
Education & Qualifications - Bachelors or Masters degree in Computer Science, Information Technology, or related field.
- MBA is a plus.
Mandatory Requirements - Minimum 10+ years of experience in data analytics, engineering, and enterprise integration.
- Proven experience architecting enterprise-scale data platforms on Azure.
- Strong hands-on expertise in Azure Databricks (PySpark, Delta Lake, Unity Catalog).
- Proficiency in Azure Data Factory, Azure Synapse Analytics, Power BI, Blob Storage, and Data Lake Gen2.
- Experience integrating SAP systems (S/4HANA, SuccessFactors, MES, LIMS, CRM) with Azure and other platforms.
- Proficient in integration technologies (SAP CPI, Azure API Management, middleware platforms).
- Deep understanding of data security and identity protocols (OAuth, JWT, SAML) and Azure Entra ID.
- Familiarity with GxP-compliant data handling and governance practices.
Desirable Requirements - Experience in pharmaceutical manufacturing and regulatory environments.
- Exposure to Azure DevOps, Terraform, or ARM templates for infrastructure automation.
- Knowledge of modern data architecture principles (Lakehouse, Data Mesh, ELT).
Preferred Certifications - Microsoft Certified: Azure Solutions Architect Expert
- Microsoft Certified: Data Engineer Associate
- Microsoft Certified: Identity and Access Administrator Associate
- SAP Certified Technology Associate SAP Integration Suite
- TOGAF or equivalent Enterprise Architecture certification
Preferred Industry Experience Pharmaceutical Manufacturing
Regulated Environments (GxP, FDA, ISO)
Experience Minimum 10 years in data architecture, analytics, and enterprise integration roles.
