BIG DATA WITH SCALA

Tata Consultancy Services

6 - 10 years

0 Lacs

hyderabad pune bengaluru

Posted:1 week ago| Platform:

Apply

Skills Required

hive oozie spark hdfs aws

Work Mode

Work from Office

Job Type

Full Time

Job Description

Desired Competencies (Technical/Behavioral Competency)

Must-Have**

(Ideally should not be more than 3-5)

Strong experience in
Hadoop ecosystem
(HDFS, Hive, Spark, Oozie).
Hands-on expertise in
AWS
and
GCP
cloud services for data engineering.
Proficiency in
Scala
and
Python
programming.
Experience with
Terraform
, DevOps practices, and Git-based workflows.
Solid understanding of
ETL design principles
and data pipeline orchestration.
Ability to perform
unit testing, integration testing
, and ensure E2E quality

Good-to-Have(Ideally should not be more than 3-5)

SN

Responsibility of / Expectations from the Role

1

Design, develop, and maintain scalable
ETL pipelines
for large datasets.
Implement
data processing workflows
using Hadoop, Hive, Spark, Oozie, and Shell scripting.
Work with
AWS services
(IAM, Kinesis, S3, Glue, Athena, Lambda, Step Functions, CloudWatch, AWS IoT) and
GCP services
(BigQuery, Dataflow, Cloud Functions, Dataproc, Cloud Composer).
Develop solutions using
Scala
and
Python
for data transformation and analytics.
Manage infrastructure as code using
Terraform
, and maintain version control with
Git
.
Ensure
end-to-end design, testing, and deployment
of data solutions.
Optimize performance and reliability of data pipelines across cloud platforms.

More Jobs at Tata Consultancy Services

Tcs Hiring For GRC , Pan India

Pune, Bengaluru, Mumbai (All Areas)

7 - 12 yrs

INR 9 - 19 Lacs

Java / Spring boot with API Developer

Pune

5 - 10 yrs

INR 9 - 19 Lacs

SAP PP and QM Consultant

Pune

4 - 9 yrs

INR 8 - 18 Lacs

SAP BTP Consultant

Pune

4 - 9 yrs

INR 9 - 19 Lacs

Customer Service Associate

Pune

1 - 6 yrs

INR 1 - 5 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.