GCP Data Engineer

Job Title: GCP Data Engineer Overview:

We are looking for a skilled GCP Data Engineer with 5+ years of real hands-on experience in data ingestion, data engineering, data quality, data governance, and cloud data warehouse implementations using GCP data services. The ideal candidate will be responsible for designing and developing data pipelines, participating in architectural discussions, and implementing data solutions in a cloud environment.  

Key Responsibilities:

•       Collaborate with stakeholders to gather requirements and create high-level and detailed technical designs.  

•       Develop and maintain data ingestion frameworks and pipelines from various data sources using GCP services.  

•       Participate in architectural discussions, conduct system analysis, and suggest optimal solutions that are scalable, future-proof, and aligned with business requirements.  

•       Design data models suitable for both transactional and big data environments, supporting Machine Learning workflows.  

•       Build and optimize ETL/ELT infrastructure using a variety of data sources and GCP services.  

•       Develop and implement data and semantic interoperability specifications.  

•       Work closely with business teams to define and scope requirements.  

•       Analyze existing systems to identify appropriate data sources and drive continuous improvement.  

•       Implement and continuously enhance automation processes for data ingestion and data transformation.  

•       Support DevOps automation efforts to ensure smooth integration and deployment of data pipelines.  

•       Provide design expertise in Master Data Management (MDM), Data Quality, and Metadata Management.  

Skills and Qualifications:

Overall 5 years of hands-on experience

SQL

•       Solid experience in data engineering, working with distributed architectures, ETL/ELT, and big data technologies.  

Google Cloud BigQuery

DataProc

DWBI modeling frameworks

•       Extensive experience in SQL across various database platforms.  

data mapping

•       Familiarity with data analytics tools and best practices.  

Python, JavaScript, Java, R, or UNIX Shell

Google Cloud services

BigQuery

Dataflow

Storage

Functions

Spanner

Hadoop, HDFS, and Spark

Looker, Airflow DAGs, Data Studio, App Maker

cloud data lake

GCP Data Engineer Certification