GCP Big Data Engineer

Role Overview: You will be responsible for designing and implementing scalable data solutions using Big Data technologies and Google Cloud Platform services. Your role will involve optimizing data pipelines, collaborating with cross-functional teams, ensuring data quality, and staying updated with emerging trends in GCP data analytics. Key Responsibilities: - Design, develop, and optimize data pipelines using GCP BigQuery, Dataflow, and Apache Airflow - Utilize the Big Data Hadoop ecosystem to manage and process large datasets efficiently - Collaborate with cross-functional teams to gather requirements and deliver reliable data solutions - Ensure data quality, consistency, and integrity across multiple data sources - Monitor and troubleshoot data workflows to maintain high system availability and performance - Optimize SQL queries and data models for performance and cost efficiency in BigQuery - Integrate Hadoop ecosystem components with GCP services to enhance data processing capabilities - Automate workflow orchestration using Apache Airflow for seamless data operations - Collaborate with data engineers, analysts, and stakeholders to ensure alignment of data solutions with organizational goals - Participate in code reviews, testing, and deployment activities adhering to best practices - Mentor junior team members and contribute to continuous improvement initiatives within the data engineering team Qualifications Required: - Mandatory Skills: GCP Storage, GCP BigQuery, GCP DataProc, GCP Cloud Composer, GCP DMS, Apache Airflow, Java, Python, Scala, GCP Datastream, Google Analytics Hub, GCP Workflows, GCP Dataform, GCP Datafusion, GCP Pub/Sub, ANSI-SQL, GCP Data Flow, GCP Cloud Pub/Sub, Big Data Hadoop Ecosystem (Note: The additional details of the company were not provided in the job description),