Gcp Data Engineer

HCLTech

6 - 10 years

14 - 24 Lacs

bengaluru

Posted:16 hours ago| Platform:

Apply

Skills Required

gcp bigquery airflow data flow dataproc google cloud platforms looker python sql

Work Mode

Hybrid

Job Type

Full Time

Job Description

Responsibilities

Design and implement scalable data pipelines using GCP services such as BigQuery, Dataflow, and Airflow.
Develop and maintain ETL processes to integrate various data sources into the data warehouse.
Collaborate with data analysts and business stakeholders to understand data requirements and deliver impactful data solutions.
Monitor and optimize data pipeline performance, ensuring reliability and efficiency.
Implement data quality checks and validation processes to maintain data integrity.
Create and manage data models using DBT to enable seamless data transformations.
Document processes, architectures, and data flows to enhance team knowledge sharing and compliance.
Stay updated with emerging technologies and industry trends in data engineering to recommend improvements and enhancements.

Requirements

Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
6 to 10 years of experience in data engineering or a related role, specifically with GCP.
Strong expertise in BigQuery and its optimization techniques for large datasets.
Proficiency in Python for scripting and building data pipelines.
Experience with Apache Airflow for orchestrating complex workflows.
Hands-on experience with Dataflow for real-time data processing.
Familiarity with DBT for data transformation and modeling in the cloud environment.

More Jobs at HCLTech

Golang Developer

Pune, Bengaluru, Noida

6 - 11 yrs

INR 16 - 31 Lacs

Aws Cloud Engineer

Chennai, Bengaluru, Hyderabad

5 - 10 yrs

INR 15 - 30 Lacs

React.js Full stack Developer

Bengaluru

1 - 3 yrs

INR 5 - 11 Lacs

Mega Walk-In Drive For Mortgage Underwriter

Bengaluru

2 - 7 yrs

INR 3 - 8 Lacs

HCL Tech Hiring For Tosca Automation Testing

Chennai

7 - 12 yrs

INR 5 - 15 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.