GCP Data Engineer - SS Req

Job Title:

Location:

Experience:

Job Type:

Job Summary:

GCP Data Engineer

Pune

Google Cloud Platform (GCP)

Dataproc

Cloud Composer (Apache Airflow)

Python/Shell Scripting,

SQL

Apache Spark

Key Responsibilities:

• Design and implement scalable and efficient data pipelines on GCP, leveraging Dataproc, BigQuery, Cloud Storage.
• Develop and manage ETL/ELT workflows using Apache Spark, SQL, and Python.
• Orchestrate and automate data workflows using Cloud Composer (Apache Airflow).
• Build batch and streaming data processing jobs that integrate data from various structured and unstructured sources.
• Optimize pipeline performance and ensure cost-effective data processing.
• Collaborate with data analysts, scientists, and business teams to understand data requirements and deliver high-quality solutions.
• Implement and monitor data quality checks, validation, and transformation logic.
  

Required Skills:

• Strong hands-on experience with Google Cloud Platform (GCP)
• Proficiency with Dataproc for big data processing and Apache Spark
• Expertise in Python and SQL for data manipulation and scripting
• Experience with Cloud Composer / Apache Airflow for workflow orchestration
• Knowledge of data modeling, warehousing, and pipeline best practices
• Solid understanding of ETL/ELT architecture and implementation
• Strong troubleshooting and problem-solving skills
  

Preferred Qualifications:

• GCP Data Engineer or Cloud Architect Certification.
• Familiarity with BigQuery, Dataflow. Exposure to Agile methodologies and team collaboration tools.