GCP Data Engineer

Job Title:

Location:

Type:

Budget:

Notice Period:

Google Cloud Platform (GCP) Data Engineer

🛠️ Key Responsibilities

• Design and implement scalable batch and real-time data pipelines using GCP services such as BigQuery, Dataflow, Dataform, Cloud Composer (Airflow), Data Fusion, Dataproc, Cloud SQL, Compute Engine, and others.
• Build data products that combine historical and live data for business insights and analytical applications.
• Lead efforts in data transformation, ingestion, integration, data mart creation, and activation of data assets.
• Collaborate with cross-functional teams including AI/ML, analytics, DevOps, and product teams to deliver robust cloud-native solutions.
• Optimize pipelines for performance, reliability, and cost-effectiveness.
• Contribute to data governance, quality assurance, and security best practices.
• Drive innovation by integrating AI/ML features, maintaining strong documentation, and applying continuous improvement strategies.
• Provide production support, troubleshoot failures, and meet SLAs using GCP’s monitoring tools.
• Work within an Agile environment, follow CI/CD practices, and apply test-driven development (TDD).
  

✅ Skills Required

• Strong experience in:
• BigQuery, Dataflow, Dataform, Data Fusion, Cloud SQL, Compute Engine, Dataproc, Airflow (Cloud Composer), Cloud Functions, Cloud Run
• Programming experience with Python, Java, PySpark, or Apache Beam
• Proficient in SQL (5+ years) for complex data handling
• Hands-on with Terraform, Tekton, Cloud Build, GitHub, Docker
• Familiarity with Apache Kafka, Pub/Sub, Kubernetes
• GCP Certified (Associate or Professional Data Engineer)
  

⭐ Skills Preferred

• Deep knowledge of cloud architecture and infrastructure-as-code tools
• Experience in data security, regulatory compliance, and data governance
• Experience with AI/ML solutions or platforms
• Understanding of DevOps pipelines, CI/CD using Cloud Build, and containerization
• Exposure to financial services data or similar regulated environments
• Experience in mentoring and leading engineering teams
• Tools: JIRA, Artifact Registry, App Engine
  

🎓 Education

• Required: Bachelor's Degree (in Computer Science, Engineering, or related field)
• Preferred: Master’s Degree
  

📌 Additional Details

• Role Type: Contract-based
• Work Location: Chennai, Onsite
• Target Candidates: Mid to Senior level with minimum 5+ years of data engineering experience