AuxoAI logo

Senior Data Engineer - Senior Data Engineer - Google Cloud PlatformF

5 years

0 Lacs

gurugram haryana india

Posted:1 week ago| Platform: Linkedin logo

Apply

Skills Required

data design development optimization engineering drive dataflow composer analytics apache clustering airflow workflow sql storage testing monitoring pipeline support documentation code planning agile programming python git architecture collaboration gcp vertex ai governance collibra docker kubernetes api integration

Work Mode

On-site

Job Type

Full Time

Job Description

Description

AuxoAI is seeking a Senior Data Engineer to lead the design, development, and optimization of modern data pipelines and cloud-native platforms using Google Cloud Platform (GCP).This role is ideal for someone with deep experience building scalable batch and streaming data workflows, strong hands-on engineering skills, and a drive to mentor junior engineers.You'll work closely with cross-functional teams to build production-grade pipelines using tools like BigQuery, Dataflow, Pub/Sub, Cloud Composer, and Dataform, enabling high-quality data delivery and analytics at scale.

Responsibilities

  • Build and optimize batch and streaming data pipelines using Apache Beam (Dataflow)
  • Design and maintain BigQuery datasets using best practices in partitioning, clustering, and materialized views
  • Develop and manage Airflow DAGs in Cloud Composer for workflow orchestration
  • Implement SQL-based transformations using Dataform (or dbt)
  • Leverage Pub/Sub for event-driven ingestion and Cloud Storage for raw/lake layer data architecture
  • Drive engineering best practices across CI/CD, testing, monitoring, and pipeline observability
  • Partner with solution architects and product teams to translate data requirements into technical designs
  • Mentor junior data engineers and support knowledge-sharing across the team
  • Contribute to documentation, code reviews, sprint planning, and agile ceremonies

Requirements

  • 5+ years of hands-on experience in data engineering, with at least 3 years on GCP
  • Proven expertise in BigQuery, Dataflow (Apache Beam), Cloud Composer (Airflow)
  • Strong programming skills in Python and/or Java
  • Experience with SQL optimization, data modeling, and pipeline orchestration
  • Familiarity with Git, CI/CD pipelines, and data quality monitoring frameworks
  • Exposure to Dataform, dbt, or similar tools for ELT workflows
  • Solid understanding of data architecture, schema design, and performance tuning
  • Excellent problem-solving and collaboration skills

Bonus Skills

  • GCP Professional Data Engineer certification
  • Experience with Vertex AI, Cloud Functions, Dataproc, or real-time streaming architectures
  • Familiarity with data governance tools (e.g., Atlan, Collibra, Dataplex)
  • Exposure to Docker/Kubernetes, API integration, and infrastructure-as-code (Terraform)
(ref:hirist.tech)

More Jobs at AuxoAI

Interesting Job Opportunity: AuxoAI - DevOps Engineer - CI/CD Pipeline

Gurugram, Haryana, India

5.0 - 5.0 yrs
|

Salary: Not disclosed

AuxoAI - Anaplan Modeler - Supply Chain Domain

Hyderabad, Telangana, India

3.0 - 3.0 yrs
|

Salary: Not disclosed

Senior Platform Engineer

maharashtra

6.0 - 10.0 yrs
|

Salary: Not disclosed

Software Engineers - Backend

haryana

3.0 - 7.0 yrs
|

Salary: Not disclosed

Fullstack Engineer

mumbai, maharashtra, india

Experience: Not specified

|

Salary: Not disclosed

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

Google Play App Store
coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
AuxoAI logo
AuxoAI

RecommendedJobs for You

AuxoAI logo

Senior Data Engineer - Senior Data Engineer - Google Cloud PlatformF

AuxoAI

gurugram, haryana, india

AuxoAI logo

Senior Data Engineer - Senior Data Engineer - Google Cloud PlatformF

AuxoAI

gurugram, haryana, india