Senior GCP Data Engineer @ Madurai

Dear Candidate,

Greetings of the day!!

I am Kantha, and I'm reaching out to you regarding an exciting opportunity with TechMango. You can connect with me on LinkedIn https://www.linkedin.com/in/kantha-m-ashwin-186ba3244/

We are a full-scale leading Software and Mobile App Development Company. Techmango is driven by the mantra Clients Vision is our Mission.

Job Title: Technical GCP Data Architect/Lead

Job Summary

hands-on Technical GCP Data Architect/Lead

Key Responsibilities

• Architect and implement end-to-end

  streaming data solutions

  on GCP using

  Pub/Sub

  ,

  Dataflow

  , and

  BigQuery

  .
• Design real-time ingestion, enrichment, and transformation pipelines for high-volume event data.
• Work closely with stakeholders to understand data requirements and translate them into scalable designs.
• Optimize streaming pipeline performance, latency, and throughput.
• Build and manage orchestration workflows using

  Cloud Composer (Airflow)

  .
• Drive schema design, partitioning, and clustering strategies in BigQuery for both real-time and batch datasets.
• Define SLAs, monitoring, logging, and alerting for streaming jobs using

  Cloud Monitoring

  ,

  Error Reporting

  , and

  Stackdriver

  .
• Experience with the data modeling.
• Ensure robust security, encryption, and access controls across all data layers.
• Collaborate with DevOps for CI/CD automation of data workflows using

  Terraform

  ,

  Cloud Build

  , and

  Git

  .
• Document streaming architecture, data lineage, and deployment runbooks.

Required Skills & Experience

• 10+ years of experience in data engineering or architecture.
• 3+ years of

  hands-on GCP data engineering

  experience.
• Strong expertise in:

• Google Pub/Sub

• Dataflow (Apache Beam)

• BigQuery (including streaming inserts)

• Cloud Composer (Airflow)

• Cloud Storage (GCS)

• Solid understanding of

  streaming design patterns

  ,

  exactly-once delivery

  , and

  event-driven architecture

  .
• Deep knowledge of SQL and NoSQL data modeling.
• Hands-on experience with

  monitoring and performance tuning

  of streaming jobs.
• Experience using

  Terraform

  or equivalent for infrastructure as code.
• Familiarity with

  CI/CD pipelines

  for data workflows.