AWS Data Engineer(Pyspark)

Tata Consultancy Services

5 - 10 years

5 - 15 Lacs

hyderabad chennai bengaluru

Posted:1 month ago| Platform:

Apply

Skills Required

pyspark aws lambda amazon redshift aws glue

Work Mode

Work from Office

Job Type

Full Time

Job Description

AWS Data Engineer

Key Responsibilities

Design and implement scalable
data pipelines
using AWS services (e.g., Glue, Lambda, Step Functions, S3, Redshift)
Build, maintain, and optimize
data lakes
and
data warehouses
Develop and deploy
ETL/ELT jobs
for data ingestion, transformation, and enrichment
Ensure
data quality
,
lineage
, and
governance
are in place
Collaborate with data analysts, scientists, and business stakeholders to understand data needs
Monitor and troubleshoot production data workflows and optimize performance
Contribute to automation, CI/CD, and infrastructure-as-code (IaC) practices

Required Skills and Experience

57 years of experience in
data engineering
Strong expertise in AWS services:
Glue, Redshift, S3, Lambda, Athena, IAM
Proficient in
SQL
and at least one programming language (e.g., Python, Scala)
Experience with data modeling and schema design (normalized and denormalized)
Familiarity with
data lakes
,
data warehouse architecture
, and
cloud security best practices
Knowledge of orchestration tools (e.g.,
Step Functions, Airflow, MWAA
)
Exposure to
CI/CD
and IaC (Terraform)

More Jobs at Tata Consultancy Services

Tcs Hiring For GRC , Pan India

Pune, Bengaluru, Mumbai (All Areas)

7 - 12 yrs

INR 9 - 19 Lacs

Java / Spring boot with API Developer

Pune

5 - 10 yrs

INR 9 - 19 Lacs

SAP PP and QM Consultant

Pune

4 - 9 yrs

INR 8 - 18 Lacs

SAP BTP Consultant

Pune

4 - 9 yrs

INR 9 - 19 Lacs

Customer Service Associate

Pune

1 - 6 yrs

INR 1 - 5 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.