Data Engineer - (GCP)

Data Engineer

We are seeking a highly motivated and skilled Data Engineer to join our dynamic team. This is a high-impact role where you will be instrumental in building and maintaining our data infrastructure, enabling data-driven decisions across the organization. We are open to remote candidates who are team players, flexible, and ready to learn.

Responsibilities

• Design, develop, and maintain scalable ETL pipelines using Python and DigDag.
• Work extensively with Google Cloud services, specifically BigQuery, for data warehousing and analytics.
• Write and optimize complex SQL queries for data extraction and transformation.
• Collaborate with data scientists, analysts, and other engineers to understand data requirements and deliver robust data solutions.
• Ensure data quality, integrity, and security across all data pipelines and systems.
• Troubleshoot and resolve data-related issues, ensuring minimal disruption to data availability.
• Continuously explore and implement new technologies and best practices in data engineering.
• Contribute to the overall data strategy and architecture.

Qualifications

• Strong experience in data engineering with a proven track record of building and deploying data pipelines.
• Proficiency in Python for data manipulation and automation.
• Experience with workflow management tools like DigDag.
• In-depth knowledge of ETL processes and data warehousing concepts.
• Extensive experience with Google Cloud Platform (GCP), especially BigQuery.
• Expertise in SQL for data querying and manipulation.
• Ability to work independently and as part of a collaborative team.
• Excellent problem-solving and analytical skills.
• Strong communication and interpersonal skills.

Preferred Qualifications

• Familiarity with other GCP data services (e.g., Cloud Storage, Cloud Pub/Sub, Dataflow).
• Experience with data visualization tools.
• Understanding of data governance and data security principles.

Job Type: Full-time

Schedule:

• Day shift
• Morning shift

Work Location: In person