5 - 10 years

Chennai Bengaluru Mumbai (all areas)

Posted:7 months ago

Apply

Job Description

Role - GCP Data Engineer

Required Technical Skill Set- GCP, PySpark, Data proc, HDFS, Hadoop, SQL

Desired Experience Range 5+ years

Location of Requirement- Bangalore/Chennai/Mumbai/Pune/Delhi

Notice period- o to 45 days

Desired Competencies (Technical/Behavioral Competency)

Must-Have

• Build, maintain, and troubleshoot pipelines using GCP services (e.g., DataProc, Pub/Sub, Cloud Functions, Cloud Composer/Apache Airflow) to ingest, transform, and load data from various sources (relational databases, APIs, streaming data, flat files).

• Implement batch data processing solutions.

• Identify and resolve data-related issues, including data quality problems, pipeline failures, and performance bottlenecks.

• Sound programming knowledge on PySpark & SQL in terms of processing large amount of semi structured & unstructured data

• Working Knowledge on working with Avro, Parquet format files • Knowledge on working on Hadoop Big Data platform and ecosystem

Skills Required

pyspark gcp hadoop dataproc hdfs pubsub bigquery data flow sql

Work Mode

Work from Office

Job Type

Full Time

Mock Interview

Practice Video Interview with JobPe AI

Start PySpark Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now
coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Tata Consultancy Services logo
Tata Consultancy Services

Information Technology and Consulting

Thane

RecommendedJobs for You

Chennai, Bengaluru, Mumbai (all areas)

Noida, Uttar pradesh, India

Bangalore rural, All india