Data Engineer

Overview: Data Engineers design, build, and maintain the data infrastructure that enables data ingestion, processing, and storage. Key Responsibilities: Design and implement data pipelines using Databricks and Apache Airflow. Build and maintain data lake architecture on Azure. Create and optimize ETL/ELT processes. Ensure data reliability, quality, and availability. Implement data security and access controls. Troubleshoot and resolve data infrastructure issues. Collaborate with Analytics Engineers to support data modeling needs. Implement monitoring and logging for data pipelines. Document technical processes and architecture. Required Skills: Strong programming skills in Python, Scala, or equivalent. Experience with Databricks, Spark, and Delta Lake. Familiarity with Azure services. Ensure data reliability, quality, and availability. Implement data security and access controls. Knowledge of data modeling and database design. Firm grasp of data security and governance principles. Experience with automation and CI/CD practices. Perks: Salary best in the industry 5 day work week Opportunity to work on challenging projects for industry leading companies Fun & relaxed workplace