Lead Data Engineer

5 - 9 years

0 Lacs

Posted:5 days ago| Platform: Shine logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

You will be responsible for leading and managing the entire offshore data engineering team, providing guidance, mentorship, and performance management. Your role will involve fostering a collaborative and high-performing team environment, overseeing resource allocation, project planning, and task prioritization. You will need to conduct regular team meetings and provide progress updates to stakeholders. Your main focus will be on designing and implementing effective database solutions and data models to store and retrieve company data. This will include examining and identifying database structural necessities by evaluating client operations, applications, and programming requirements. You will also need to assess database implementation procedures to ensure compliance with internal and external regulations. In addition, you will be responsible for installing and organizing information systems to guarantee company functionality, preparing accurate database design and architecture reports for management and executive teams, and overseeing the migration of data from legacy systems to new solutions. Monitoring system performance, recommending solutions to improve database systems, and designing and implementing scalable and efficient ETL/ELT processes using Azure Data Factory, Databricks, and other relevant tools will also be part of your role. Furthermore, you will be required to build and maintain data warehouses and data lakes using Azure Synapse, Snowflake, BigQuery, and Azure Data Lake. Developing and optimizing data pipelines for data ingestion, transformation, and loading, implementing data quality checks and validation processes, and supporting data analytics initiatives by providing access to reliable and accurate data will be essential. You will also need to develop data visualizations and dashboards using Power BI and Tableau, collaborate with data scientists and business analysts to translate business requirements into technical solutions, educate staff members through training and individual support, work within an Agile Scrum framework, and utilize IT Service Management best practices. Providing Techno-Functional Management will also be part of your responsibilities. **Mandatory Skills And Expertise:** - Azure SQL - Azure Data Factory - Azure Data Lake - Azure Databricks - Azure Synapse - Snowflake - BigQuery - T-SQL - DBT - ETL/ELT - PySpark - Data Warehousing - Data Analytics - Data Visualization **Qualifications:** - Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field. - Proven experience leading and managing data engineering teams. - Extensive experience in designing and implementing data solutions on Azure and other cloud platforms. - Strong understanding of data warehousing, data modeling, and ETL/ELT concepts. - Proficiency in SQL and scripting languages (Python, PySpark). - Excellent communication, leadership, and problem-solving skills. - Proven experience in client-facing roles.,

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now

RecommendedJobs for You

indore, madhya pradesh, india