Pyspark Developer

Tata Consultancy Services

6 - 10 years

0 Lacs

chennai tamil nadu india

Posted:2 days ago| Platform:

Apply

Skills Required

pyspark developer design development deployment data etl writing sql relational server git pipeline docker kubernetes aws redshift apache spark extraction query tuning optimization support scrum

Work Mode

On-site

Job Type

Full Time

Job Description

TCS is Hiring Pyspark Developer For Chennai, Hyderabad, Kolkata location

Experience

Mode of interview

Location

Must have:

Minimum 3 Years of experience in design, development and deployment of big data applications and ETL jobs using
PySpark APIs/sparkSQL.
Experience in design, build and deployment of
Python
based applications.
Experience in writing complex SQL queries/procedures using Relational databases like
SQL Server
or
Oracle
Experience in version control system like Git and CI/CD pipeline is a must.
Experience in Delta lake APIs is a plus
Experience in Docker and Kubernetes is a plus
Knowledge of
AWS services
like S3, Athena, Glue, Lambda, Redshift or Cloud platform is a plus

Responsibilities:

Designing, implementing, and maintaining jobs written in PySpark for extracting raw data, applying transformation, and writing into file/tables on Apache Spark cluster.
Writing complex queries as per the business rules and data extraction logic
Query tuning and Performance optimization of various components as and when required.
Work with development leads, System Architects and other teams (as needed) to manage dependencies, risks and issues.
Contributing in all phases of the development lifecycle
Support testers and defect resolution
Update status/risks/issues/impediments in daily scrum calls to the customer and track it to closure.
Writing testable, scalable and efficient code
Working on the necessary documentations as needed

More Jobs at Tata Consultancy Services

Tcs Hiring For GRC , Pan India

Pune, Bengaluru, Mumbai (All Areas)

7 - 12 yrs

INR 9 - 19 Lacs

Java / Spring boot with API Developer

Pune

5 - 10 yrs

INR 9 - 19 Lacs

SAP PP and QM Consultant

Pune

4 - 9 yrs

INR 8 - 18 Lacs

SAP BTP Consultant

Pune

4 - 9 yrs

INR 9 - 19 Lacs

Customer Service Associate

Pune

1 - 6 yrs

INR 1 - 5 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.