Pyspark Developer

Tata Consultancy Services

6 - 8 years

18 - 25 Lacs

mumbai navi mumbai mumbai (all areas)

Posted:5 hours ago| Platform:

Apply

Skills Required

pyspark python spark

Work Mode

Work from Office

Job Type

Full Time

Job Description

Min. 5 yrs on role Software Engineering + Backend Eng. (one of languages: Python, Java, Scala, Rust - with focus on Python today)
practice with high quality codes (unit testing, integration testing, others) + code metrics
fast discovery what is in new repository code, asking right technical questions about codebase and code quality, CI/CD as a general rule of work (automatic tasks, instead of manual)
Min. 5 yrs on role near "data" subject like Data Engineer or Integrations Engineer
strong understanding data pipelines in
Apache Spark, Apache Airflow
and similar orchestrators
understanding on mid.level
Databricks
or other modern platforms BigData solutions inside (i.e. data catalogs, computes engines, SQL engines, observability layers, etc.)
strong focus on delivery data pipelines on high quality from data product delivery perspective
practical exp. with data streams and Petabytes scale
Min. 1 yr with exp. near data integrations (data pipelines, connection for diff. types of data sources and sinks)
Basic AWS knowledge (Lambda, SQS, CloudWatch, Powertools)
Soft skills for discussion with vendors/partners about possible solutions/limits/properties in technical integrations and different data architectures

More Jobs at Tata Consultancy Services

Tcs Hiring For GRC , Pan India

Pune, Bengaluru, Mumbai (All Areas)

7 - 12 yrs

INR 9 - 19 Lacs

Java / Spring boot with API Developer

Pune

5 - 10 yrs

INR 9 - 19 Lacs

SAP PP and QM Consultant

Pune

4 - 9 yrs

INR 8 - 18 Lacs

SAP BTP Consultant

Pune

4 - 9 yrs

INR 9 - 19 Lacs

Customer Service Associate

Pune

1 - 6 yrs

INR 1 - 5 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.