Senior Data Engineer (GCP)

Senior Data Engineer

Key Responsibilities

• Architect, build, and optimize large-scale batch and streaming data pipelines using frameworks such as

  Apache Spark

  on

  GCP (mandatory)

  or AWS.
• Design, manage, and automate data flows across multiple systems and data stores.
  
• Define and enforce data quality, reliability, and governance standards.
  
• Develop scalable, efficient, and secure data processing solutions.
  
• Collaborate with cross-functional teams (Product, Analytics, Engineering) to translate business requirements into robust data solutions.
  
• Implement CI/CD, testing, and automation best practices for data workflows.
  
• Monitor and optimize system performance and cost efficiency.
  
• Stay current with emerging technologies and drive continuous improvements in the data stack.
  

Qualifications

• Experience:

  48 years in data engineering or backend data systems.
• Strong foundation in

  data structures

  ,

  algorithms

  , and

  system design

  .
• Proficiency in

  Python

  or

  Scala

  (preferred).
• Hands-on experience with

  Big Data frameworks:

  Spark, Hadoop, Hive, Sqoop, HDFS, Airflow, Zookeeper.

• Mandatory:

  Experience working with

  Google Cloud Platform (GCP)

  — BigQuery, Dataflow, Composer, Dataproc, Pub/Sub, Cloud Storage, etc.
• Experience with

  Databricks Notebooks

  and

  Jobs API

  is a strong plus.
• Strong knowledge of

  SQL

  (RDBMS + NoSQL: Postgres, MySQL, Redshift, Redis) with query optimization and schema design.
• Familiarity with

  Docker

  ,

  Kubernetes

  , and workflow orchestration tools such as

  Airflow

  or

  Luigi

  .
• Proficient with

  Git

  and collaborative development workflows.
• Excellent communication, analytical, and problem-solving skills.
  

Role Details

• Role:

  Senior Data Engineer

• Industry Type:

  Software Product (AdTech / MarTech)

• Department:

  Engineering – Data & Software

• Employment Type:

  Full Time, Permanent

• Role Category:

  Data Engineering / Software Development

Key Skills

Role & responsibilities