Azure - Lead Data Engineer

HTC Global Services (India) Private Limited

8 - 13 years

1 - 3 Lacs

chennai tamil nadu india

Posted:5 days ago| Platform: Foundit logo

Apply

Skills Required

azure - lead data engineer

Work Mode

On-site

Job Type

Full Time

Job Description

Lead Data Engineer

Key Responsibilities:

Lead the design, development, and implementation of scalable data pipelines using
Azure Data Services, Databricks, and Python
.
Architect and optimize
ETL workflows
to ensure data integrity and efficiency.
Collaborate with
data scientists, analysts, and business stakeholders
to understand data requirements and provide robust solutions.
Manage and mentor a team of data engineers, providing guidance on best practices and performance optimization.
Implement and enforce
data governance, security, and compliance
standards.
Troubleshoot and resolve data pipeline issues, ensuring high availability and reliability.
Optimize
data storage, transformation, and retrieval
for large datasets in a cloud environment.

Required Skills & Experience:

8+ years of experience in
Data Engineering
, with at least
2+ years in a lead role
.
Strong hands-on experience with
Azure Data Services
(Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake).
Expertise in
Databricks
and
Spark
for big data processing.
Proficiency in
Python
for data manipulation and pipeline development.
Deep understanding of
ETL/ELT processes
and best practices.
Experience with
CI/CD pipelines
and
DevOps practices
for data engineering.
Strong knowledge of
data modeling, warehousing concepts, and performance tuning
.
Excellent problem-solving, analytical, and communication skills.

More Jobs at HTC Global Services (India) Private Limited

Workday Integration Consultants

Bengaluru / Bangalore, Karnataka, India

3.0 - 7.0 yrs

INR 2 - 4 Lacs

Lead Data Scientist

Bengaluru / Bangalore, Karnataka, India

8.0 - 13.0 yrs

INR 7 - 14 Lacs

As400 Developer

Hyderabad / Secunderabad, Telangana, Telangana, India

6.0 - 11.0 yrs

INR 1 - 3 Lacs

AEM Engineer

Chennai, Tamil Nadu, India

2.0 - 6.0 yrs

INR 2 - 4 Lacs

Oracle SaaS Procurement Consultant

Bengaluru / Bangalore, Karnataka, India

5.0 - 10.0 yrs

INR 2 - 5 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.