Lead Data Engineer

As a Lead Data Engineer at our company located in Indore, Madhya Pradesh, you will play a crucial role in our dynamic team by utilizing your extensive experience and expertise in PySpark, Azure Data Bricks, Azure Data Factory, SQL, and Power BI. Your main focus will be on designing, constructing, and managing scalable data solutions that are essential for our diverse projects. Your responsibilities will involve data architecture, pipeline development, and ensuring data governance across various initiatives. - Lead the creation and enhancement of robust data pipelines using Azure Data Factory and PySpark - Build scalable data solutions and workflows within Azure Databricks - Write efficient SQL queries for data manipulation - Develop and maintain dashboards and reports with Power BI - Uphold best practices in data security, governance, and compliance - Collaborate with diverse teams, mentor junior engineers, and monitor data pipelines for optimal performance To excel in this role, you should have: - Minimum 5 years of hands-on experience in PySpark, Azure Data Factory, Azure Databricks, SQL, and at least 2 years in Power BI - Solid understanding of ETL/ELT processes and modern data architecture - Expertise in handling large-scale structured and semi-structured datasets - Exposure to Microsoft Fabric for integrated analytics and automation - Knowledge of data security, governance, and privacy frameworks - Familiarity with DevOps practices in data engineering environments Joining our team will expose you to impactful projects with cutting-edge technologies in a fast-paced, collaborative, and learning-driven environment. You can anticipate a competitive salary and a growth path within our tech-driven organization.,