GCP Data Engineer (specialist)

Platform: GCP

Position Overview:

We are seeking a skilled and experienced GCP Data Engineer to join our team. As a GCP Data Engineer, you will be responsible for designing, implementing and maintaining our data infrastructure and pipelines on the Google Cloud Platform (GCP).

Key Responsibilities:

Design & Development:

• Design and implement data ingestion pipelines, data processing workflows, and data storage solutions using GCP services such as Cloud Storage, Big Query, Dataflow, Composer etc.
• Work with other DEs to integrate data solutions into existing or new applications.
• Develop and manage data integration processes to extract data from various sources, transform and cleanse it, and load it into appropriate data storage systems.
• Implement robust ETL processes to ensure data quality and consistency.

Data Modeling and Optimization:

• Design and implement data models and schemas that meet business requirements and support efficient data retrieval and analysis.
• Optimize data structures and queries for performance and scalability.

Monitoring and Maintenance:

• Monitor data pipelines and processes for data quality issues.
• Troubleshoot and resolve data-related problems in a timely manner.
• Perform regular data backups and implement disaster recovery procedures.

Collaboration and Documentation:

• Collaborate with cross-functional teams to understand data requirements and provide technical guidance and support.
• Document data infrastructure, processes, and workflows to ensure knowledge sharing and maintainability.

Qualifications and Skills:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field

  .

• 8 years experience as a Data Engineer, preferably 5 years in Google Cloud Platform.

• Strong knowledge of GCP services such as Cloud Storage, Big Query, Dataflow, Dataproc, Cloud Composer, Pub/Sub, Airflow, DAG etc.
• Proficiency in SQL and experience with Data Modeling and Optimization.
• Experience with data integration and ETL processes.
• Familiarity with programming languages such as Python.
• Understanding of data security and compliance requirements.
• Excellent problem-solving and troubleshooting skills.
• Strong communication and collaboration skills.

We’re an equal opportunity employer.