Data Engineer-GCP

As a skilled Data Engineer with experience in Google Cloud Platform (GCP), PySpark, SQL, and ETL processes, your role will involve building, optimizing, and maintaining scalable data pipelines and workflows. You will utilize technologies like Apache Airflow, PySpark, and other cloud-native tools. Key Responsibilities: - Design, develop, and maintain efficient and scalable data pipelines using PySpark and SQL. - Build and manage workflows/orchestration with Apache Airflow. - Utilize GCP services such as BigQuery, Cloud Storage, Dataflow, and Composer. - Implement and optimize ETL processes to ensure data quality, consistency, and reliability. - Collaborate with data analysts, data scientists, and engineering teams to support data needs. - Monitor pipeline performance and troubleshoot issues as they occur. - Write clean, maintainable, and well-documented code. Required Skills & Qualifications: - Strong programming skills in PySpark and SQL. - Proven experience with Google Cloud Platform (GCP). - Solid understanding of ETL concepts and data pipeline design. - Hands-on experience with Apache Airflow or similar orchestration tools. - Familiarity with cloud-based data warehousing and storage systems like BigQuery and Cloud Storage. - Experience in performance tuning and optimizing large-scale data pipelines. - Strong problem-solving skills and the ability to work independently or as part of a team.,