Data Engineer

About the Role

MarTech Data Engineering POD

offshore team

Key Responsibilities

• Design and develop

  data ingestion, transformation, and orchestration pipelines

  using GCP (BigQuery, Dataflow, Cloud Composer) and Airflow.
• Implement and maintain

  data integrations between AEP and data lake

  , ensuring high performance and scalability.
• Build and optimize

  ETL/ELT workflows

  to support campaign orchestration, preference logic, and audience segmentation.
• Implement

  data quality checks, monitoring, and exception handling

  frameworks to ensure clean and reliable data.
• Work closely with Lead DE and SME to translate

  campaign archetypes into data pipelines and orchestration rules

  .
• Support performance tuning, data reconciliation, and defect resolution during testing and hypercare phases.
• Collaborate with QA team for end-to-end test validation and ensure production readiness.
• Participate in daily Agile ceremonies, sprint reviews, and deployment planning.

Required Technical Skills

• Strong hands-on experience in

  GCP services

  : BigQuery, Dataflow, GCS, Cloud Composer (Airflow).
• Proficiency in

  SQL

  for data profiling, transformation, and performance optimization.
• Proficiency in

  Python

  for pipeline automation, scripting, and orchestration.
• Experience building

  batch and streaming data pipelines

  .
• Exposure to working with

  marketing or customer engagement platforms

  is a plus.
• Understanding of

  data quality

  , logging, monitoring, and alerting best practices.

Preferred Skills

• Experience in

  Airflow DAG development

  for complex data pipelines.
• Familiarity with

  MarTech platforms

  such as Adobe Experience Platform or similar ESPs.
• Knowledge of

  data modeling

  for campaign orchestration and audience segmentation.
• Experience with

  CI/CD and DevOps

  principles for data deployments.
• Strong troubleshooting and performance tuning skills.

Soft Skills & Attributes

• Strong problem-solving skills and attention to detail.
• Ability to work effectively in a

  distributed global POD model

  (onsite + offshore).
• Proactive communication and ownership mindset.
• Comfortable working in

  fast-paced agile environments

  with tight timelines.
• Excellent verbal and written communication skills.

Education

• Bachelors or Masters degree in Computer Science, Information Technology, or a related field.
• GCP certifications (e.g.,

  Professional Data Engineer

  ) preferred but not mandatory