Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Home
>
Jobs in coimbatore
>
IQZ Systems
>
Lead Data Engineer

Lead Data Engineer

IQZ Systems

5 - 8 years

8 - 13 Lacs

coimbatore

Posted:22 hours ago| Platform:

Apply

Skills Required

team management data modeling coding project management mysql oracle apache monitoring sql python

Work Mode

Work from Office

Job Type

Full Time

Job Description

Location: Hybrid

Type: Full-time

Job Overview

We are seeking an experienced Lead Data Engineer to architect, design, and lead the development of our enterprise data infrastructure. The ideal candidate will have strong technical leadership skills, deep expertise in data engineering technologies, and experience managing data engineering teams across the globe.

Key Responsibilities

Technical Leadership

Architecture Design:
Design and implement scalable, robust data architectures for enterprise-level data processing
Data Pipeline Leadership:
Lead the development of complex ETL/ELT pipelines processing terabytes of data
Technology Strategy:
Evaluate and recommend cutting-edge data technologies and tools
Performance Optimization:
Optimize data processing performance and implement best practices
Data Quality:
Establish and maintain data quality standards and governance framework.

Team Management

Team Leadership:
Lead and mentor a team of 3-5 Data Engineers
Code Reviews:
Conduct thorough code reviews and establish coding standards
Technical Mentoring:
Guide junior engineers in advanced data engineering concepts
Project Management:
Manage multiple data engineering projects simultaneously
Stakeholder Communication:
Collaborate with product managers, analysts, and business stakeholders

Data Infrastructure

Cloud Architecture:
Design and implement cloud-native data solutions (AWS/Azure/GCP)
Big Data Processing:
Lead implementation of distributed computing frameworks (Spark, Hadoop)
Real-time Systems:
Architect streaming data pipelines using Kafka, Flink, or similar
Data Warehousing:
Design and optimize data warehouses and data lakes

Technical Requirements

Core Skills (Must Have)

Experience:
5-8 years in data engineering with 2+ team leader role
Programming:
Proficient in level Python, Spark and equivalent programming with experience in data engineering libraries
SQL Mastery:
Advanced SQL skills with experience in PostgreSQL, MySQL, SQL Server, Oracle
Cloud Platforms:
Deep experience with Databricks, Snowflake, AWS, Azure, or Google Cloud Platform
ETL/ELT:
Expert in designing and implementing complex data pipelines
Big Data:
Strong experience with Apache Spark, Hadoop ecosystem
Version Control:
Advanced Git workflows and CI/CD practices

Advanced Skills (Highly Preferred)

Streaming:
Experience with Apache Kafka, Apache Flink, or similar streaming platforms
Orchestration:
Apache Airflow, Prefect, or similar workflow orchestration tools
Containerization:
Docker, Kubernetes for data engineering workloads
Monitoring:
Data pipeline monitoring and observability tools
Data Modeling:
Advanced data modeling techniques (Star Schema, Data Vault, etc.)
Data Governance:
Good understanding on Data Governance and Security implementation on Data Solutions.

Leadership Skills

Team Management:
Proven experience leading data engineering teams
Technical Communication:
Ability to explain complex technical concepts to non-technical stakeholders
Project Management:
Experience managing multiple concurrent projects
Mentoring:
Strong mentoring and coaching abilities
Problem Solving:
Advanced troubleshooting and problem-solving skills

Disclaimer: The job location mentioned in this description is based on publicly available information or company headquarters. Candidates are advised to verify the exact job location directly with the employer before applying.

More Jobs at IQZ Systems

Azure Application Architect

coimbatore

8.0 - 13.0 yrs

INR 10 - 20 Lacs

Lead Data Engineer

coimbatore

5.0 - 8.0 yrs

INR 8 - 13 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now

IQZ Systems

Before You Leave... Find Your Perfect Job!

Login to

Please Verify Your Phone or Email

Confirm Action

Contact Us

Lead Data Engineer

Experience & Salary

Skills Required

Work Mode

Job Type

Job Description

Job Overview

Key Responsibilities

Technical Leadership

Architecture Design:

Data Pipeline Leadership:

Technology Strategy:

Performance Optimization:

Data Quality:

Team Management

Team Leadership:

Code Reviews:

Technical Mentoring:

Project Management:

Stakeholder Communication:

Data Infrastructure

Cloud Architecture:

Big Data Processing:

Real-time Systems:

Data Warehousing:

Technical Requirements

Core Skills (Must Have)

Experience:

Programming:

SQL Mastery:

Cloud Platforms:

ETL/ELT:

Big Data:

Version Control:

Advanced Skills (Highly Preferred)

Streaming:

Orchestration:

Containerization:

Monitoring:

Data Modeling:

Data Governance:

Leadership Skills

Team Management:

Technical Communication:

Project Management:

Mentoring:

Problem Solving:

More Jobs at IQZ Systems