Job
Description
Role Overview: You will be working as a GCP Data Engineer at StatusNeo, where you will be responsible for designing, developing, and maintaining scalable data pipelines and architectures on Google Cloud Platform. Your role will involve collaborating with data scientists, analysts, and other stakeholders to ensure that data systems are optimized for performance, reliability, and scalability. Key Responsibilities: - Design and implement data pipelines using GCP services such as BigQuery, Dataflow, Pub/Sub, and Cloud Storage. - Utilize tools like Apache Beam, Apache Spark, and Dataproc for data ingestion, processing, and transformation. - Manage and optimize cloud-based data storage solutions, ensuring data quality and integrity. - Work closely with data scientists and analysts to understand data requirements and translate them into technical solutions. - Monitor and troubleshoot data pipelines, implementing improvements for efficiency and reliability. - Maintain comprehensive documentation and adhere to best practices in data engineering. Qualifications Required: - Bachelors degree in Computer Science, Engineering, or a related field. - 3+ years of experience in data engineering or a similar role. - Strong experience with GCP services such as pyspark, BigQuery, Dataflow, Pub/Sub, Cloud Storage. - Proficiency in SQL and experience with data modeling. - Familiarity with scripting languages such as Python or Java. - Experience with data integration tools like Apache Beam or similar. - Excellent analytical and troubleshooting abilities. Role Overview: You will be working as a GCP Data Engineer at StatusNeo, where you will be responsible for designing, developing, and maintaining scalable data pipelines and architectures on Google Cloud Platform. Your role will involve collaborating with data scientists, analysts, and other stakeholders to ensure that data systems are optimized for performance, reliability, and scalability. Key Responsibilities: - Design and implement data pipelines using GCP services such as BigQuery, Dataflow, Pub/Sub, and Cloud Storage. - Utilize tools like Apache Beam, Apache Spark, and Dataproc for data ingestion, processing, and transformation. - Manage and optimize cloud-based data storage solutions, ensuring data quality and integrity. - Work closely with data scientists and analysts to understand data requirements and translate them into technical solutions. - Monitor and troubleshoot data pipelines, implementing improvements for efficiency and reliability. - Maintain comprehensive documentation and adhere to best practices in data engineering. Qualifications Required: - Bachelors degree in Computer Science, Engineering, or a related field. - 3+ years of experience in data engineering or a similar role. - Strong experience with GCP services such as pyspark, BigQuery, Dataflow, Pub/Sub, Cloud Storage. - Proficiency in SQL and experience with data modeling. - Familiarity with scripting languages such as Python or Java. - Experience with data integration tools like Apache Beam or similar. - Excellent analytical and troubleshooting abilities.
