AWS Data Engineer + Pyspark

Tata Consultancy Services

6 - 11 years

12 - 22 Lacs

hyderabad

Posted:4 weeks ago| Platform:

Apply

Skills Required

spark redshift aws aws python

Work Mode

Work from Office

Job Type

Full Time

Job Description

Implementing data ingestion pipelines from different types of data sources i.e Databases, S3, Files etc..

Experience in building ETL/ Data Warehouse transformation process.
Developing Big Data and non-Big Data cloud-based enterprise solutions in PySpark and SparkSQL and related frameworks/libraries,
Developing scalable and re-usable, self-service frameworks for data ingestion and processing,
Integrating end to end data pipelines to take data from data source to target data repositories ensuring the quality and consistency of data,
Processing performance analysis and optimization,
Bringing best practices in following areas: Design & Analysis, Automation (Pipelining, IaC), Testing, Monitoring, Documentation.
Experience working with structured and unstructured data.

Good to have (Knowledge)

1. Experience in cloud-based solutions,

2. Knowledge of data management principles.

More Jobs at Tata Consultancy Services

Tcs Hiring For GRC , Pan India

Pune, Bengaluru, Mumbai (All Areas)

7 - 12 yrs

INR 9 - 19 Lacs

Java / Spring boot with API Developer

Pune

5 - 10 yrs

INR 9 - 19 Lacs

SAP PP and QM Consultant

Pune

4 - 9 yrs

INR 8 - 18 Lacs

SAP BTP Consultant

Pune

4 - 9 yrs

INR 9 - 19 Lacs

Customer Service Associate

Pune

1 - 6 yrs

INR 1 - 5 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.