Senior Data Engineer(GCP, Python)

Responsibilities

• Design, develop, and maintain

  scalable ETL/ELT pipelines

  for high-volume data processing
• Optimize and automate data

  ingestion

  ,

  transformation

  , and

  storage workflows

• Handle both

  structured

  and

  unstructured data sources

  , ensuring

  data quality

  and

  consistency

• Develop and maintain

  data models

  ,

  data warehouses

  , and

  databases

• Collaborate with

  cross-functional teams

  to support and enable data-driven decision-making
• Ensure

  data security

  ,

  privacy

  , and

  compliance

  with industry and regulatory standards
• Troubleshoot and resolve

  data-related issues

  promptly and efficiently
• Monitor and enhance

  system performance

  ,

  reliability

  , and

  scalability

• Stay up-to-date with

  emerging data technologies

  and recommend improvements to data architecture and engineering practices

What You Will Need

• 5+ years

  of experience in

  data engineering

  ,

  ETL development

  , or a related field
• Strong programming skills in

  Python

• Proficiency in

  SQL

  and experience with both

  relational databases

  (e.g., PostgreSQL, MySQL) and

  NoSQL databases

  (e.g., DynamoDB, MongoDB)
• Proven experience building data pipelines on

  Google Cloud Platform (GCP)

  using services like:

• DataFlow

  ,

  Cloud Batch

  ,

  BigQuery

  ,

  BigTable

  ,

  Cloud Functions

  ,

  Cloud Workflows

  ,

  Cloud Composer

• Solid understanding of

  data modeling

  ,

  data warehousing

  , and

  data governance

  principles
• Capability to

  mentor junior data engineers

  and assist with technical challenges
• Familiarity with

  orchestration tools

  such as

  Apache Airflow

• Experience with

  containerization and orchestration

  tools like

  Docker

  and

  Kubernetes

• Proficiency with

  version control systems

  (e.g., Git) and

  CI/CD pipelines

• Excellent

  problem-solving

  and

  communication skills

• Ability to work effectively in a

  fast-paced

  , agile environment
• Experience with

  Snowflake

  ,

  big data technologies

  (e.g., Hadoop, Spark, Kafka), and

  AWS

  is a plus
• Skilled at converting

  business requirements

  into

  technical documentation

Education and Experience

• Bachelor's degree in

  Computer Science

  ,

  Information Systems

  ,

  Information Technology

  , or a related field

• Certified development training/program

  is a plus

• 5+ years

  of hands-on experience building data pipelines using

  Python

  and

  GCP