Senior Data Engineer

The Opportunity:

The Senior Platform Engineer designs, builds, automates, and operates the shared data and AI platform capabilities used by engineering, analytics, governance, and AI teams.
This senior hands-on role establishes reusable platform patterns across Databricks, Microsoft Azure, Microsoft Fabric, CI/CD, observability, security, and cost management. The role also provides technical leadership for platform reliability, operational maturity, and developer enablement.

What you’ll do…

Platform Architecture & Engineering

• Design and implement secure, scalable platform services for Databricks, Azure Data Lake, Microsoft Fabric, and supporting cloud services.
• Create reusable environment patterns for development, test, and production workloads.
• Implement workspace, network, identity, storage, compute, catalog, policy, and secrets-management configurations.
• Partner with Architecture and Security to translate enterprise standards into practical platform controls and reference implementations.

Automation, DevOps & Developer Experience

• Develop infrastructure-as-code modules, deployment pipelines, automated configuration, and policy-as-code controls.
• Establish CI/CD patterns for data pipelines, notebooks, libraries, semantic assets, and AI workloads.
• Build self-service templates and paved-road capabilities that improve delivery consistency and reduce manual provisioning.
• Maintain source-control, release, artifact, environment-promotion, and rollback practices.

Reliability, Observability & Cost Management

• Define and implement monitoring, alerting, logging, capacity, performance, availability, and recovery standards.
• Lead troubleshooting and root-cause analysis for complex platform incidents and recurring reliability issues.
• Implement operational dashboards, service-level indicators, runbooks, and on-call support patterns.
• Analyze platform usage and cost drivers; implement guardrails, tagging, budgets, and optimization recommendations.

Technical Leadership & Governance

• Lead platform design reviews and provide technical guidance to Platform Engineers and delivery teams.
• Develop engineering standards, operating procedures, support models, and platform documentation.
• Embed data governance, lineage, classification, access control, and audit requirements into platform capabilities.
• Evaluate platform features and emerging technologies, recommending pragmatic adoption paths aligned with business outcomes.

Who you are?

• 2–4 years of experience in information security or cloud engineering, with at least 1–2 years working with Azure.
• Strong understanding of core security principles (identity, access control, encryption, network security).
• Hands-on experience with Azure security services, including: o Microsoft Defender for Cloud o Azure Sentinel (SIEM) o Azure Policy and Blueprints o Azure AD security features (MFA, Conditional Access, PIM)
• Ability to collaborate and communicate effectively with cross-functional teams.
• Hands-on experience configuring, integrating, and operating leading cloud security tools such as CrowdStrike, Wiz, Prisma Cloud, or similar solutions for threat detection, posture management, and compliance.

Preferred:

• Certification such as Microsoft Certified: Azure Security Engineer Associate (AZ-500).
• Experience with Infrastructure-as-Code (Terraform, Bicep) for secure deployments.
• Exposure to DevSecOps practices and CI/CD pipeline security.

#LI-VK