Prodapt Solutions logo

DT - Technical Architect

Prodapt Solutions
Chennai

Posted:10 hours ago

Job Description

Overview:
We are looking for a skilled and detail-oriented GCP Data Engineer to join our growing data engineering team. The ideal candidate will have hands-on experience designing, building, and optimizing scalable data pipelines on Google Cloud Platform, along with strong problem-solving and communication skills to collaborate effectively with cross-functional and global stakeholders.
Responsibilities: Key Responsibilities
  • Design, develop, and maintain robust, scalable, and efficient data pipelines on Google Cloud Platform (GCP).
  • Work extensively with BigQuery (BQ) for data warehousing, query optimization, and large-scale data analysis.
  • Build and manage big data processing workflows using Dataproc (Hadoop/Spark ecosystem on GCP).
  • Write, optimize, and troubleshoot complex SQL queries for data transformation, validation, and reporting.
  • Design, schedule, and monitor data workflows using Cloud Composer (Apache Airflow).
  • Perform root-cause analysis and troubleshooting of pipeline failures, data quality issues, and performance bottlenecks in production environments.
  • Collaborate with data analysts, data scientists, and business stakeholders to understand requirements and deliver reliable data solutions.
  • Ensure data governance, security, and compliance standards are followed across all GCP data engineering solutions.
  • Participate in code reviews, design discussions, and knowledge-sharing sessions within the team.
  • Document technical designs, data flows, and operational runbooks for supportability.
Requirements: Required Technical Skills
Skill
Proficiency Expected

Google Cloud Platform (GCP)
Strong hands-on experience

BigQuery (BQ)
Query optimization, partitioning, clustering, cost management

Dataproc
Spark/Hadoop job design and management

SQL
Advanced query writing, performance tuning

Cloud Composer / Apache Airflow
DAG design, scheduling, monitoring

Troubleshooting
Strong analytical and debugging skills for pipeline/data issues

Good to Have (Additional Skills)
  • Ab Initio – ETL development and pipeline migration experience.
  • DevOps – CI/CD pipelines, version control (Git), containerization (Docker/Kubernetes), infrastructure as code (Terraform) is a plus.
  • Prior Data/ETL Migration Experience – Hands-on experience migrating data pipelines, ETL workloads, or on-premise data warehouses to cloud platforms (e.g., on-prem to GCP, or cross-cloud migrations) is a strong value add.
Soft Skills
  • Excellent communication skills – ability to clearly articulate technical concepts to both technical and non-technical stakeholders.
  • Strong ownership mindset and ability to work independently as well as within a team.
  • Good stakeholder management skills, especially in a global/MNC delivery environment.
  • Ability to work under pressure and manage multiple priorities in a fast-paced environment.

Qualifications
  • Bachelor's/Master's degree in Computer Science, Information Technology, Engineering, or a related field.
  • GCP certification (e.g., Professional Data Engineer) is a plus.

Skills Required

GCP Data Engineering Google Cloud Platform Data Warehousing Query Optimization Data Analysis BIG Data Hadoop Spark SQL Queries Data Transformation Apache

Learn the skills this job asks for

Free courses, interview questions and practice for each skill.

Work Mode

Remote

Mock Interview

Practice Video Interview with JobPe AI

Start Big Data Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

coding practice

Enhance Your Skills

Practice coding challenges to boost your skills

Start Practicing Now
Prodapt Solutions logo
Prodapt Solutions

RecommendedJobs for You

Prodapt Solutions logo

DT - Technical Architect

Prodapt Solutions

Chennai

Prodapt Solutions logo

DT - Technical Architect

Prodapt Solutions

Chennai