Lead Data Engineer (GCP)

Codehive Labs Hyderabad

7 - 12 years

20 - 30 Lacs

hyderabad

Posted:1 week ago| Platform:

Apply

Skills Required

bigquery data flow google cloud platforms gcp cloud pubsub dataproc

Work Mode

Remote

Job Type

Full Time

Job Description

Role & responsibilities

The Lead Data Engineer will build, optimize, and maintain high-throughput data pipelines on GCP, ensuring resilient imports, freshness monitoring, and automation-readiness. This role leads engineering teams to deliver scalable data solutions.

Responsibilities

Develop and maintain
large-scale ingestion and transformation pipelines on GCP
.
Implement monitoring and alerting for
data freshness and resiliency
.
Optimize ETL/ELT using
BigQuery, Dataflow, Pub/Sub, Dataproc
.
Collaborate with AI teams to embed automation components.
Drive best practices in DevOps, CI/CD, and testing.
Mentor engineers and lead Agile delivery cycles.

Technical Skills

Proficiency in
GCP data stack (BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage)
.
Strong programming skills in
Python, SQL, PySpark, Java/Scala
.
Experience with
Airflow/Cloud Composer
for orchestration.
Knowledge of
CI/CD with Cloud Build, Cloud Deploy, Terraform for GCP
.
Hands-on with
data quality frameworks and observability tools
.

Preferred candidate profile

More Jobs at Codehive Labs Hyderabad

BI Migration Developer

Hyderabad

6.0 - 9.0 yrs

INR 15 - 20 Lacs

Senior Python Developer (Django + FastAPI)

Hyderabad

6.0 - 11.0 yrs

INR 15 - 22 Lacs

Big Data Developer

Hyderabad

5.0 - 10.0 yrs

INR 15 - 25 Lacs

Azure Data Engineer

Hyderabad

5.0 - 10.0 yrs

INR 10 - 20 Lacs

Cognos PowerBI Migration Developer

Hyderabad

6.0 - 10.0 yrs

INR 12 - 18 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Job-Specific Interview

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.