Lead Data Engineer

As a Lead Data Engineer at the company located in Indore, Madhya Pradesh, you will be an integral part of the dynamic team, leveraging your extensive experience and expertise in PySpark, Azure Data Bricks, Azure Data Factory, SQL, and Power BI. Your primary responsibility will involve designing, constructing, and managing scalable data solutions vital for various projects. Your role will encompass data architecture, pipeline development, and ensuring data governance across initiatives. - Lead the creation and enhancement of robust data pipelines using Azure Data Factory and PySpark - Build scalable data solutions and workflows within Azure Databricks - Write efficient SQL queries for data manipulation - Develop and maintain dashboards and reports using Power BI - Uphold best practices in data security, governance, and compliance - Collaborate with diverse teams, mentor junior engineers, and monitor data pipelines for optimal performance To excel in this role, you must have: - Minimum 5 years of hands-on experience in PySpark, Azure Data Factory, Azure Databricks, SQL - At least 2 years of experience in Power BI - Solid understanding of ETL/ELT processes and modern data architecture - Expertise in handling large-scale structured and semi-structured datasets - Exposure to Microsoft Fabric for integrated analytics and automation - Knowledge of data security, governance, and privacy frameworks - Familiarity with DevOps practices in data engineering environments Joining the team will offer you the opportunity to work on impactful projects with cutting-edge technologies in a fast-paced, collaborative, and learning-driven environment. Expect a competitive salary and a growth path within the tech-driven organization.,