GCP Data Engineer (BigQuery , Pyspark)

Tata Consultancy Services

5 - 10 years

5 - 15 Lacs

hyderabad chennai bengaluru

Posted:9 hours ago| Platform:

Apply

Skills Required

pyspark gcp bigquery python

Work Mode

Work from Office

Job Type

Full Time

Job Description

Job Title :

Job Location

Experience:

Requirement:

Mandatory to have knowledge of Big Data Architecture Patterns and experience in delivery of BigData and Hadoop Ecosystems.
Strong experience required in GCP . Must have done multiple large projects with GCP Big Query and ETL
Experience working in GCP based Big Data deployments (Batch/Realtime) leveraging components like GCP Big Query, air flow, Google Cloud Storage, Data fusion, Data flow, Data Proc etc
Should have experience in SQL/Data Warehouse
Expert in programming languages like Java, Hadoop, Scala
Expert in at least one distributed data processing frameworks: like Spark (Core, Streaming , SQL), Storm or Flink etc.
Should have worked on any of Orchestration tools Oozie , Airflow , Ctr-M or similar, Kubernetes.
Worked on Performance Tuning, Optimization and Data security
Preferred Experience and Knowledge:
Excellent understanding of data technologies landscape / ecosystem.
Good Exposure in development with CI / CD pipelines. Knowledge of containerization, orchestration and Kubernetes engine would be an added advantage.
Well versed with pros and cons of various database technologies like Relational, BigQuery, Columnar databases, NOSQL
Exposure in data governance, catalog, lineage and associated tools would be an added advantage.
Well versed with SaaS, PaaS and IaaS concepts and can drive clients to a decisions
Good skills in Python Language and PYSPARK

Key word:

GCP , BigQuery , Python, Pyspark

More Jobs at Tata Consultancy Services

Tcs Hiring For GRC , Pan India

Pune, Bengaluru, Mumbai (All Areas)

7 - 12 yrs

INR 9 - 19 Lacs

Java / Spring boot with API Developer

Pune

5 - 10 yrs

INR 9 - 19 Lacs

SAP PP and QM Consultant

Pune

4 - 9 yrs

INR 8 - 18 Lacs

SAP BTP Consultant

Pune

4 - 9 yrs

INR 9 - 19 Lacs

Customer Service Associate

Pune

1 - 6 yrs

INR 1 - 5 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.