Pyspark Developer

Tata Consultancy Services

5 - 8 years

10 - 20 Lacs

hyderabad bengaluru delhi / ncr

Posted:15 hours ago| Platform:

Apply

Skills Required

pyspark spark python

Work Mode

Work from Office

Job Type

Full Time

Job Description

Must-Have

Mandatory: Primary skill: Pyspark.
3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project.
Must have excellent knowledge in Apache Spark and Python programming experience.
Experience in developing data processing tasks using PySpark such as reading data from external sources, merging data, aggregating data, performing data enrichment, and loading into target data destinations.
Hands-on project experience on Jupyter Notebook/ PyCharm etc. IDE
Should have experience in fine-tuning process and troubleshooting performance issue.
Experience in source code control systems like git, GitHub, SVN etc.
Experience in deployment and operationalizing the code, knowledge of scheduling tools like Control-M etc. is preferred.
Experience in CI/CD tools like Jenkins, Nexus, Ansible etc.
Excellent communication and interpersonal skills.

Good-to-Have

Understanding of Unix/Linux Shell Scripting
Should understand and have operating experience with Agile delivery methodologies.
Should have hands-on experience in the following: data validation, writing unit test cases.
Working experience of ETL Tools like Data Stage, Talend etc. is an added advantage.
Working experience on Databricks / Delta Lake is an added advantage.

More Jobs at Tata Consultancy Services

Tcs Hiring For GRC , Pan India

Pune, Bengaluru, Mumbai (All Areas)

7 - 12 yrs

INR 9 - 19 Lacs

Java / Spring boot with API Developer

Pune

5 - 10 yrs

INR 9 - 19 Lacs

SAP PP and QM Consultant

Pune

4 - 9 yrs

INR 8 - 18 Lacs

SAP BTP Consultant

Pune

4 - 9 yrs

INR 9 - 19 Lacs

Customer Service Associate

Pune

1 - 6 yrs

INR 1 - 5 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.