Gcp Data Engineer

Job Title: GCP Data Engineer

Location: Gurugram (Full-Time, Work from Office)

Industry: Life Insurance

Experience: 9-12 years

Job Summary

We are seeking an experienced and dynamic GCP Data Engineer Manager to lead our cloud data engineering initiatives as a consultant. You will be responsible for architecting, building, and managing scalable and efficient data pipelines on Google Cloud Platform (GCP), while guiding a team of data engineers to deliver robust, high-quality data solutions. Your expertise will drive data engineering best practices and support data analytics and machine learning initiatives, ultimately empowering business decision-making.

Key Responsibilities

• Lead the design, development, and deployment of end-to-end data engineering solutions on Google Cloud Platform (GCP), including data ingestion, transformation, storage, and orchestration.
• Manage and mentor a team of data engineers, facilitating their technical growth and ensuring delivery excellence.
• Collaborate with Data Scientists, Analysts, and Business stakeholders to understand data requirements and translate them into scalable data pipelines.
• Architect and implement data solutions using GCP services such as BigQuery, Cloud Functions, Cloud SQL, Dataproc, Pub/Sub, Cloud Storage, Cloud Composer, and others.
• Establish and enforce best practices in data pipeline development, code quality, testing, deployment, and monitoring.
• Ensure data solutions comply with security, privacy, and governance policies.
• Optimize the performance and cost-efficiency of data processing workflows.
• Drive continuous improvement by evaluating and adopting new technologies and tools within the GCP ecosystem.
• Manage project delivery timelines, resource allocation, and stakeholder communication.
• Provide technical leadership during pre-sales and architectural design sessions.
• Prepare documentation, architecture diagrams, and data flow models.
• Support troubleshooting, incident management, and root cause analysis for data platform issues.

Required Skills & Qualifications

Minimum 9+ years of experience in data engineering, with at least 3 years specifically on Google Cloud Platform.

• Proven experience managing and leading teams of data engineers.
• Strong expertise with GCP data services including BigQuery, Cloud Functions, Cloud SQL, Dataproc, Pub/Sub, Cloud Storage, Cloud Composer etc
• Deep understanding of data warehousing concepts, ETL/ELT processes, and data modeling.
• Proficiency in programming languages such as Python, Pyspark, or SQL for data pipeline development.
• Experience with containerization (Docker), orchestration (Kubernetes), and CI/CD pipelines is a plus.
• Knowledge of data governance, security best practices, and compliance requirements.
• Experience with batch and real-time data processing.
• Excellent problem-solving and analytical skills.
• Strong communication skills with the ability to interact effectively with both technical teams and business stakeholders.
• Cloud certification like Google Professional Data Engineer is preferred.

Preferred Qualifications

• Experience with infrastructure-as-code tools like Terraform or Deployment Manager.
• Familiarity with machine learning workflows on GCP.
• Prior consulting experience, able to handle multiple clients and adapt solutions accordingly.
• Agile and DevOps experience.