Technical Lead-GCP Data Engineer

Business Title:

Data Engineer

Years of Experience:

Minimum 6 to 10 years

Role Overview

Data Engineer

You will collaborate closely with internal stakeholders and clients, translating business requirements into effective technical solutions. Strong communication skillsboth technical and non-technical—are essential for success in this role.

Key Responsibilities

• Design, develop, and maintain

  data pipelines

  and

  ETL processes

  across cloud and on-prem environments.
• Apply strong knowledge of

  data warehousing, data marts, data modeling

  , and

  data transformation

  .
• Build and manage

  RESTful APIs

  using

  Python (Flask)

  and integrate with third-party APIs to ingest data into

  Google Cloud Platform (GCP)

  .
• Use

  ETL tools

  (Talend, Informatica, SSIS, DataStage, Matillion) for data extraction, transformation, and loading.
• Implement secure and reliable

  API authentication mechanisms

  (OAuth 2.0, API Keys, Service Accounts).
• Manage and troubleshoot API connectors to ensure continuous and secure data flow.
  
• Utilize

  workflow orchestration tools

  such as Airflow, Tidal, Tivoli, or Stonebranch.
• Participate in

  code reviews

  , ensure adherence to development standards, and contribute to technical design documentation.
• Perform

  root cause analysis

  and provide quick resolutions for production issues.
• Lead small teams (2–3 members) and manage 1–2 projects simultaneously.
  
• Collaborate with

  data scientists, analysts, and client teams

  to support analytical and marketing data solutions.
• Manage

  code repositories

  , oversee

  version control

  , and ensure smooth deployments.
• Continuously improve and optimize data solutions for performance, scalability, and cost efficiency.
  

Must-Have Skills

• Strong expertise in

  SQL

  and

  Database Technologies

  (SQL Server, Snowflake, BigQuery, etc.)
• Hands-on experience with

  Google Cloud Platform (GCP)

  — BigQuery, Cloud Run, Cloud Functions, GCS

• Python programming

  (Flask, OOP principles, API development)

• ETL Tools

  – Talend / Informatica / SSIS / DataStage / Matillion

• Workflow Orchestration

  – Airflow / Tidal / Tivoli / Stonebranch
• Experience building

  Microservices

  and

  REST APIs

• UNIX shell scripting

• Strong

  client-facing communication

  and

  project management

  skills
• Experience integrating with

  third-party APIs

  using GCP-native tools

Good-to-Have Skills

• Experience with

  other Cloud Platforms

  (AWS, Azure)
• Exposure to

  CI/CD pipelines

• Familiarity with

  containerization (Docker, Kubernetes)

• Knowledge of

  DataOps or DevOps

  practices

Education Qualification

• Bachelor’s or Master’s Degree in Computer Science, Information Technology, or related field
  

Certifications (Preferred)

• GCP Certification

  (Minimum Basic Level)

• Snowflake Associate / Core Certification

Shift Timings

• 12 PM to 9 PM IST

• 2 PM to 11 PM IST

  (as per project requirement)