Lead Data Engineer

Incedo

7 - 9 years

18 - 32 Lacs

gurugram

Posted:9 hours ago| Platform:

Apply

Skills Required

azure pyspark python sql

Work Mode

Work from Office

Job Type

Full Time

Job Description

Roles and Responsibilities :

Design, develop, test, deploy and maintain large-scale data pipelines using PySpark on Azure Data Factory (ADF) to extract insights from various sources.
Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs through data analysis and visualization.
Develop complex SQL queries to optimize database performance and troubleshoot issues related to data quality, integrity, and security.
Ensure compliance with industry standards for data governance, privacy, and security by implementing best practices in the development process.

Job Requirements :

7-9 years of experience as a Lead Engineer in a similar role or equivalent combination of education & experience.
Strong proficiency in Python programming language along with expertise in working with PySpark on Azure Data Factory (ADF).
Experience with Microsoft Azure platform including storage services such as Blob Storage, Cosmos DB etc., streaming analytics services like Stream Analytics.

More Jobs at Incedo

voice of Customer

Chennai

2 - 5 yrs

INR 0 - 0 Lacs

Senior Java Lead || 8+ yrs || Hyderabad || Immediate joiners

Hyderabad

8 - 13 yrs

INR 15 - 30 Lacs

C# Automation Testing || Incedo || 5-10 yrs || Bengaluru || Immediate

Chennai, Bengaluru

5 - 10 yrs

INR 10 - 19 Lacs

Java Developer || 5+ yrs || Gurugram/Hyderabad || Immediate joiners

Hyderabad, Gurugram

5 - 6 yrs

INR 10 - 18 Lacs

Java Lead || Incedo || 7+ yrs only || Gurugram

Gurugram

7 - 12 yrs

INR 16 - 30 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.