Jobs

Interviews
Job Alerts
Tools

Upskill and Grow with AI

Mock Interview Practice interviews in realistic simulations

Coding Practice Improve your coding skills with challenges

Certification Earn certifications to validate your skills

AI Learning Get trained with AI expert sessions

Career Path AI insights for smarter career decisions

AI Job Match Score AI-Powered Job Match Against Your Resume and Optimize Your Resume

Career Tools and Resources

Resume Builder Build Professional Resume with Ease

ATS Friendliness Check Check Resume Friendliness for Applicant Tracking Systems

Auto Apply Apply to hundreds of jobs on any platform effortlessly

Co-Pilot (Chrome Extension) Your AI Assistant for Seamless Browsing Efficiency

Interview Questions Streamline interviews with ready-to-use questions

Salaries Discover market-driven salary insights across skillsets and geographies

Companies Explore leading companies actively hiring talent
For Employers

Jobs

Interviews

Home
>
Jobs in Hyderabad
>
Thoughtworks
>
Lead Data Engineer

Lead Data Engineer

Thoughtworks

6 years

0 Lacs

Hyderabad Telangana India

Posted:12 hours ago| Platform:

Apply

Skills Required

data aws scala governance security compliance engineering design etl orchestration redshift architecture terraform logical support collaboration agile planning documentation processing spark kafka sql apache airflow azure

Work Mode

On-site

Job Type

Full Time

Job Description

Job Summary

Data Engineer

Key Responsibilities

Data Engineering & Development

Design and develop reliable, scalable ETL/ELT data pipelines using
Scala
,
SQL
, and orchestration tools.
Integrate and process structured, semi-structured, and unstructured data from various sources (APIs, databases, flat files, etc.).
Develop solutions on
AWS
(e.g., S3, Glue, Redshift, EMR) and
Azure
(e.g., Data Factory, Synapse, Blob Storage).

Cloud & Infrastructure

Build cloud-native data solutions that align with enterprise architecture standards.
Leverage IaC tools (Terraform, CloudFormation, ARM templates) to deploy and manage infrastructure.
Monitor performance, cost, and security posture of data environments in both AWS and Azure.

Data Architecture & Governance

Collaborate with data architects to define and implement logical and physical data models.
Apply data governance principles including
data cataloging
,
lineage tracking
,
data privacy
, and
compliance (e.g., GDPR)
.
Support the enforcement of data policies and data quality standards across data domains.

Collaboration & Communication

Work cross-functionally with data analysts, scientists, architects, and business stakeholders to support data needs.
Participate in Agile ceremonies and contribute to sprint planning and reviews.
Maintain clear documentation of pipelines, data models, and data flows.

Required Qualifications

Bachelor's degree in Computer Science, Engineering, or a related field.
3–6 years of experience in data engineering or data platform development.
Hands-on experience with
AWS
and
Azure
data services.
Proficient in
Scala
for data processing (e.g., Spark, Kafka Streams).
Strong SQL skills and familiarity with distributed systems.
Experience with orchestration tools (e.g., Apache Airflow, Azure Data Factory).

More Jobs at Thoughtworks

Senior Consultant - Application Developer (Java)

Pune, Maharashtra, India

Experience: Not specified

Salary: Not disclosed

DevOps Engineer

Bengaluru, Karnataka, India

Experience: Not specified

Salary: Not disclosed

Senior Consultant - Developer (Python)

Pune, Maharashtra, India

30.0 - 30.0 yrs

Salary: Not disclosed

Senior Consultant Project Manager

Hyderabad, Telangana, India

30.0 - 30.0 yrs

Salary: Not disclosed

Principal Business Development Manager - BFSI

Mumbai, Maharashtra, India

16.0 - 16.0 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.