Job
Description
As a Senior Developer Data Engineer, you will play acrucial role in designing, developing, and maintaining data pipelines andplatforms within the Google Cloud Platform (GCP) ecosystem. Your expertise instreaming data, Kafka migration, and GCP services will contribute to thesuccess of our data-driven initiatives. Key Responsibilities Design, implement, and optimize streaming data ingestion and transformation pipelines using GCP services (Pub/Sub, Dataflow, Dataproc). Lead the migration of Confluent Kafka pipelines to GCP, ensuring seamless transition. Work with GCP data platforms and applications (Pub/Sub, GCS, BQ, Airflow, Composer) to automate data workflows. Implement CI/CD practices for data pipeline deployment and manage code repositories on GitHub. Write efficient code in Scala, Spark, Java, and Python for data processing. Collaborate with cross-functional teams to understand data requirements and translate them into efficient solutions. Maintain ETL processes and contribute to data warehouse architecture (HDFS, Hive, Impala, Sqoop, Flume, HBase). Technology skills GCP Services: Pub/Sub, Dataflow, Dataproc, BQ, Composer, Airflow Kafka: Migration, configuration, troubleshooting Programming Languages: Scala, Spark, Java, Python, HiveQL CI/CD: Deployment pipelines, version control (GitHub) ETL: Hadoop ecosystem (HDFS, Hive, Impala, Sqoop, Flume, HBase Required qualifications to be successful in this role Bachelors degree in computer science engineering, or related field. 5-8 years of experience in data engineering, with a focus on GCP. Strong problem-solving skills and ability to troubleshoot complex data issues. Familiarity with cloud-native architecture and microservices. Excellent communication and collaboration skills. What We Offer Competitive salaries and comprehensive health benefits Flexible work hours and remote work options. Professional development and training opportunities. A supportive and inclusive work environment
