GCP Data Engineer

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines and ETL processes using GCP services such as BigQuery, Cloud Data Fusion, Dataflow, Pub/Sub, Cloud Storage, Composer ,Cloud Function, Cloud RUN
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
• Implement data integration solutions to ingest, process, and store large volumes of structured and unstructured data from various sources.
• Optimize and tune data pipelines for performance, reliability, and cost-efficiency.
• Ensure data quality and integrity through data validation, cleansing, and transformation processes.
• Develop and maintain data models, schemas, and metadata to support data analytics and reporting.
• Monitor and troubleshoot data pipeline issues, ensuring timely resolution and minimal disruption to data workflows.
• Stay up-to-date with the latest GCP technologies and best practices, and provide recommendations for continuous improvement.
• Mentor and guide junior data engineers, fostering a culture of knowledge sharing and collaboration.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• 4 to 6 years of experience in data engineering, with a strong focus on GCP.
• Proficiency in GCP services such as BigQuery, Cloud Data Fusion, Dataflow, Pub/Sub, Cloud Storage, Composer ,Cloud Function, Cloud RUN.
• Strong programming skills in Python, PLSQL.
• Experience with SQL and NoSQL databases.
• Knowledge of data warehousing concepts and best practices.
• Familiarity with data integration tools and frameworks.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.
• Ability to work in a fast-paced, dynamic environment.