Job Description

Job Title: Senior Data Engineer Experience: 6+ Years About the Role:We are seeking a highly skilled and experienced Senior Data Engineer to join our growing data team. The ideal candidate will have hands-on expertise in Azure Data Factory (ADF), Databricks, and Medallion architecture, along with a strong background in data modeling and ETL development. You will play a key role in designing and building scalable, high-performance data pipelines to support advanced analytics and business intelligence initiatives. Key Responsibilities:Design, develop, and maintain robust ETL/ELT pipelines using Azure Data Factory and Databricks.Implement Medallion architecture (Bronze, Silver, Gold layers) for structured data processing and transformation.Collaborate with data architects and analysts to develop and optimize data models (Star/Snowflake) for reporting and analytics.Ensure data quality, integrity, and governance across the data pipeline.Build reusable data engineering frameworks and components.Tune performance and manage costs across data pipelines in Azure.Monitor data workflows, troubleshoot issues, and ensure timely data availability.Work closely with cross-functional teams including BI, Data Science, and DevOps. Required Skills & Qualifications:Bachelor's/Master’s degree in Computer Science, Information Technology, or a related field.6+ years of experience in Data Engineering or ETL development.Strong hands-on experience with Azure Data Factory (ADF) and Databricks (Spark with Python/Scala).In-depth knowledge of Medallion architecture and best practices in organizing data lake layers.Expertise in data modeling techniques (conceptual, logical, physical) and dimensional modeling.Proficient in writing complex SQL queries and performance tuning.Experience with Delta Lake, Lakehouse architecture, and Parquet/JSON/Avro file formats.Knowledge of CI/CD processes and version control systems (e.g., Git).Excellent communication, collaboration, and problem-solving skills.