Lead Data Engineer

Techno Facts Solutions

8 - 11 years

9 - 15 Lacs

hyderabad

Posted:2 hours ago| Platform:

Apply

Skills Required

data engineering azure data factory airflow pyspark snowflake spark etl aws data bricks python

Work Mode

Work from Office

Job Type

Full Time

Job Description

Job Title: Lead Data Engineer

Location:

Lead Data Engineer

Key Responsibilities

Lead and guide a team of Data Engineers across development and deployment cycles.
Design, build, and optimize scalable data pipelines and ETL/ELT workflows.
Build high-performance data solutions using modern data engineering tools and cloud services.
Work with large-scale datasets, streaming platforms, and cloud data warehousing systems.
Collaborate with Data Architects, Analysts, and Product teams to define data models and requirements.
Implement best practices in performance tuning, optimization, version control, CI/CD, and security.
Lead troubleshooting, root-cause analysis, and production support for data pipelines.
Ensure high code quality, documentation, and adherence to engineering standards.

Required Skills

Strong expertise in
Python/Scala
, SQL, and distributed data frameworks.
Hands-on experience with
Apache Spark, Databricks, Hadoop, Kafka
, or similar technologies.
Experience working with cloud platforms like
AWS / Azure / GCP
(any one mandatory).
Experience in building and managing
ETL/ELT pipelines
, Data Lakes, and Data Warehouses.
Experience with
Airflow, ADF, Glue, EMR, Step Functions
or other orchestrators.
Strong understanding of data modelling, partitioning, performance optimization.
Experience working with
Snowflake / Redshift / BigQuery
(preferred).
Ability to lead, review code, mentor junior engineers, and manage project timelines.

Good to Have

Experience in streaming technologies (Kafka, Kinesis, Spark Streaming).
DevOps/CI-CD experience (GitLab, Jenkins, Azure DevOps).
Exposure to ML pipelines, data governance, and data quality frameworks.

Additional Details

Drive Date:
Wednesday, 3rd Dec 2025
Mode:
In-Person
Location:
Hyderabad

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.