Data Engineer - Zero Trust and IAM

Role Overview: You are expected to have at least 3+ years of professional experience in building and operating production-grade applications and services across the stack, including frontend, backend, and databases. Your strong programming skills in Python and/or Scala and SQL will enable you to write modular, testable, and well-documented code for batch and streaming workloads. You should be well-versed in modern data engineering stacks, including distributed processing tools like Apache Spark (preferably Databricks), PySpark/Scala, orchestration tools such as Azure Data Factory or Apache Airflow, and event-driven patterns with Azure Functions/Logic Apps. Your expertise should also cover storage & formats like Delta Lake/Lakehouse, ADLS Gen2, Parquet/Avro, Hive Metastore/Unity Catalog, data modeling, IAM domain expertise, standards & protocols, cloud proficiency, and DevOps/DevSecOps practices. Excellent collaboration and communication skills are necessary to partner with various teams and stakeholders. Key Responsibilities: - Design and implement scalable ingestion, transformation, and serving layers to unify identity data across different sources. - Develop streaming and micro-batch pipelines for near-real-time identity signals to support conditional access and continuous verification. - Engineer robust connectors and integrations with idempotent processing, backpressure handling, and replay capabilities. - Establish DataOps practices including environment-as-code, test pyramids, CI/CD with quality gates, and reproducible runtime configurations. - Partner with IAM/SecEng to define reference architectures and paved paths for identity analytics and governance. - Create self-service semantic layers and well-documented APIs/SQL endpoints for downstream consumers. - Drive operational excellence through instrumentation, dashboards & alerts, SLOs/error budgets, on-call rotations, incident response, and continuous improvement. - Contribute to documentation and mentor engineers on data engineering best practices and secure coding standards. Qualifications Required: - Bachelor's degree in Computer Science, Data/Software Engineering, or equivalent experience. - Certifications such as Microsoft Certified: Azure Data Engineer Associate (DP203), Azure Security Engineer (AZ500), Identity and Access Administrator (SC300), Databricks Data Engineer Professional, Okta Certified Professional/Developer, SailPoint IdentityNow Engineer, CyberArk Defender are nice to have. - Security certifications indicating breadth (e.g., CISSP, GIAC) are a plus for cross-domain collaboration.,