Data Engineer - Google Cloud Platform

The IT Firm

5 years

0 Lacs

greater kolkata area

Posted:2 days ago| Platform:

Apply

Skills Required

data design etl dataflow storage analytics python sql processing scalability security support migration integration docker kubernetes gcp airflow composer terraform communication

Work Mode

On-site

Job Type

Full Time

Job Description

Responsibilities

Design, build, and maintain data pipelines and ETL workflows on Google Cloud Platform.
Work with BigQuery, Dataflow, Pub/Sub, Dataproc, and Cloud Storage to enable scalable data solutions.
Develop and optimize data models, transformations, and analytics layers.
Write efficient Python/SQL scripts for data processing and automation.
Collaborate with cross-functional teams to understand data requirements and deliver solutions.
Implement best practices for performance, scalability, security, and cost optimization.
Support data migration and integration from traditional databases to BigQuery.
Work with CI/CD pipelines, Docker, and Kubernetes for deployment.

Requirements

5+ years of hands-on experience in Data Engineering
Strong expertise in Google Cloud Platform (GCP) services BigQuery, Dataflow, Pub/Sub, Dataproc
Proficiency in Python and SQL for large-scale data processing
Solid experience with ETL pipelines, data modeling, and performance tuning
Familiarity with Airflow/Cloud Composer for orchestration
Experience with Docker, Kubernetes, Terraform, CI/CD is a plus
Excellent problem-solving and communication skills

(ref:hirist.tech)

More Jobs at The IT Firm

SAP APO Consultant - E2E Implementation

Greater Kolkata Area

10.0 - 10.0 yrs

Salary: Not disclosed

Software Development Engineer - Test - Automation Testing

Chennai, Tamil Nadu, India

Experience: Not specified

Salary: Not disclosed

Backend Engineer - Python/Microservices Architecture

Greater Kolkata Area

8.0 - 8.0 yrs

Salary: Not disclosed

Android Developer - Java/Kotlin

Chennai, Tamil Nadu, India

47.0 - 47.0 yrs

Salary: Not disclosed

Java Lead - Spring Boot/Microservices Architecture

Chennai, Tamil Nadu, India

812.0 - 812.0 yrs

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.