Azure Databricks Engineer

Key Responsibilities * Design, develop, and maintain data pipelines using Azure Databricks, PySpark, and SQL. * Build and optimize ETL/ELT workflows for processing structured and unstructured data. * Work with Azure Data Factory, Azure Data Lake Storage (ADLS), and Azure Synapse Analytics. * Implement data transformations, data quality checks, and performance optimization. * Develop and manage Delta Lake tables and implement incremental data processing. * Ensure data security, governance, reliability, and pipeline monitoring. * Collaborate with data architects, analysts, and business stakeholders to deliver data solutions. Required Skills * 5 years of experience in data engineering, with hands-on Azure Databricks experience. * Strong proficiency in Python, PySpark, and SQL. * Experience with Apache Spark, Delta Lake, and ETL/ELT development. * Good knowledge of Azure Data Factory, ADLS Gen2, and Azure cloud services. * Experience in performance tuning, troubleshooting, and data pipeline optimization. * Familiarity with Git, CI/CD pipelines, and Agile methodologies. Preferred Skills * Experience with Azure DevOps, Unity Catalog, and data governance. * Knowledge of data warehousing concepts and dimensional modelling. * Exposure to Azure Synapse Analytics, Power BI, or Microsoft Fabric.

Pay: ₹50,000.00 - ₹1,880,000.00 per month

Work Location: In person