Gcp Data Engineer

Job Title:

About the Team

TechnoGen’s Client

Key focus areas include:

• Centralizing data from enterprise systems like ERP, E-Commerce, CRM, Order Management, etc., into a cloud-based data warehouse.
  
• Designing robust ETL/ELT pipelines using cutting-edge tools and frameworks.
  
• Delivering curated, business-ready datasets for strategic decision-making and self-service analytics.
  
• Enforcing enterprise-wide data quality, governance, and testing standards.
  
• Orchestrating workflows with tools like Airflow/Cloud Composer.
  
• Collaborating with analysts, product owners, and BI developers to meet business goals through data.
  

Opportunity Overview

Data Engineer / ETL Developer

Key Responsibilities

• Design and develop scalable data integration pipelines for structured/semi-structured data from systems like ERP, CRM, E-Commerce, and Order Management.
  
• Build analytics-ready pipelines transforming raw data into curated datasets for reporting and insights.
  
• Implement modular and reusable DBT-based transformation logic aligned with business needs.
  
• Optimize BigQuery performance using best practices (partitioning, clustering, query tuning).
  
• Automate workflows with Cloud Composer (Airflow) for reliable scheduling and dependency handling.
  
• Write efficient Python and SQL code for ingestion, transformation, validation, and tuning.
  
• Develop and maintain strong data quality checks and validation mechanisms.
  
• Collaborate cross-functionally with analysts, BI developers, and product teams.
  
• Utilize modern ETL platforms like Ascend.io, Databricks, Dataflow, or Fivetran.
  
• Contribute to CI/CD processes, monitoring, and technical documentation.
  

Desired Profile

• Bachelor's or Master's in Computer Science, Data Engineering, Information Systems, or related fields.
  

• 4+ years

  of hands-on experience in

  data engineering

  and analytics pipeline development.
• Expertise in:
  

• Google BigQuery

• Python

  for scripting and integration

• SQL

  for complex transformations and optimization

• DBT

  for modular transformation pipelines

• Airflow / Cloud Composer

  for orchestration
• Solid understanding of

  ETL/ELT development

  ,

  data architecture

  , and

  governance frameworks

  .

Preferred (Nice to Have)

• Experience with

  Ascend.io

  ,

  Databricks

  ,

  Fivetran

  , or

  Dataflow

  .
• Familiarity with tools like

  Collibra

  for data governance.
• Exposure to

  CI/CD pipelines

  , Git-based workflows, and infrastructure automation.
• Experience with

  event-driven streaming

  (Pub/Sub, Kafka).
• Agile methodology experience (Scrum/Kanban).
  
• Excellent communication and problem-solving skills.
  
• Ability to handle architecture and design troubleshooting on the ground.
  
• Quick learner with an innovative mindset.
  

Apply Now: