GCP Data Engineer - UK Shift

HCLTech

5 - 8 years

15 - 25 Lacs

pune bengaluru

Posted:1 week ago| Platform:

Apply

Skills Required

bigquery spark python pyspark hive gcp github jira

Work Mode

Hybrid

Job Type

Full Time

Job Description

Experience:5-8 years

We are seeking a skilled and experienced Data Engineerto join our data engineering team. The ideal candidate will have deep expertise in building scalable data pipelines and solutions usingPySpark, BigQuery, Python, andGoogle Cloud Platform (GCP)services.

Key Responsibilities:

Create PySpark jobs , Python Scripts, and Big Query SQL for data transformation and aggregation.
Produce unit tests for PySpark transformations to ensure accuracy.
Understanding the requirements and Low Level and High Level Design of PySpark Jobs
Write PEP8-compliant documentation for all code.
Design and optimize data processing pipelines for scalability and performance.
Collaborate with data engineering teams to ensure efficient data flow and architecture.

Required Skills:

Strong proficiency in PySpark, Python and Big Query SQL with a focus on functional programming paradigms.
Expertise in Spark query tuning and performance optimization.
Hands-on experience on GCP services Big Query, Dataproc, Composer, Cloud Function, GCS, etc.
Solid understanding of SQL and relational database concepts like star schema, joins, etc.
Experience working with Big Query, GCS, HDFS and Hive.
Deep understanding of distributed systems architecture
Extensive experience in Github version control system, JIRA

More Jobs at HCLTech

Golang Developer

Pune, Bengaluru, Noida

6 - 11 yrs

INR 16 - 31 Lacs

Aws Cloud Engineer

Chennai, Bengaluru, Hyderabad

5 - 10 yrs

INR 15 - 30 Lacs

React.js Full stack Developer

Bengaluru

1 - 3 yrs

INR 5 - 11 Lacs

Mega Walk-In Drive For Mortgage Underwriter

Bengaluru

2 - 7 yrs

INR 3 - 8 Lacs

HCL Tech Hiring For Tosca Automation Testing

Chennai

7 - 12 yrs

INR 5 - 15 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.