Job Description

Required Qualifications: 10+ years of experience in data engineering, with expertise in Azure Databricks, Azure Data Lakehouse, and Delta Lake. Hands-on experience implementing Medallion Architecture, building and managing Bronze, Silver, and Gold data layers. Strong experience with Azure Data Lake Storage (ADLS) and integration with Delta Lake for efficient data storage and querying. Customer Data Platform (CDP) experience, with the ability to design and integrate customer-centric data architectures that drive personalized analytics. Experience in data governance, security, and compliance using Azure tools like Azure Purview, Data Catalog, and Key Vault. Proven experience in ETL/ELT development and real-time data ingestion pipelines, working with large-scale datasets. Strong knowledge of SQL, Python, and Spark for data processing, analysis, and pipeline development. Familiarity with data modeling techniques, big data technologies, and data warehousing in a cloud environment. Excellent communication and collaboration skills, with the ability to work cross-functionally and lead data-driven initiatives. Preferred Qualifications: Experience with machine learning and advanced analytics workflows using Azure Databricks. Familiarity with API integration and real-time data streaming solutions like Azure Event Hubs or Azure Stream Analytics. Knowledge of DevOps for data, including automated CI/CD pipelines for data deployments.