Lead Databricks Data Engineer

As a Lead Databricks Data Engineer based in Ghansoli, Navi Mumbai, you will be responsible for leading the design and implementation of robust data pipelines and solutions. We are looking for a resource who can join our team within 2-3 weeks. With over 8 years of experience in data engineering, you will leverage your deep technical expertise in Databricks, PySpark, and Azure Data Factory (ADF) to ensure the success of our data integration efforts. Your key responsibilities will include designing, developing, and optimizing large-scale data pipelines using Databricks and PySpark, as well as leading data integration efforts using Azure Data Factory. You will collaborate with cross-functional teams to define data requirements and deliver solutions, ensuring data quality, governance, and security across all pipelines. Additionally, you will mentor junior engineers and contribute to architectural decisions. To excel in this role, you must possess 8+ years of experience in data engineering with a strong focus on Databricks and PySpark. Your expertise should also extend to ADF, Delta Lake, and the Azure ecosystem. A solid understanding of distributed computing, data modeling, and performance tuning is essential, as well as experience with CI/CD pipelines and DevOps practices for data engineering. Excellent communication and leadership skills will be key to your success in this role.,