Data Engineer - Google Cloud Platform

Key Responsibilities :

- Design, build, and maintain scalable and robust data pipelines and ETL workflows using GCP services.

- Work extensively with BigQuery, Cloud Storage, Cloud Dataflow, and other GCP components to ingest, process, and transform large datasets.

- Leverage big data frameworks such as Apache Spark and Hadoop to process structured and unstructured data efficiently.

- Develop and optimize SQL queries and Python scripts for data transformation and automation.

- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.

- Implement best practices for data quality, monitoring, and alerting for data workflows.

- Ensure compliance with data governance policies, including data privacy, security, and regulatory standards.

- Continuously improve system performance and reliability by identifying and resolving bottlenecks or inefficiencies.

- Participate in code reviews, architecture discussions, and technical planning.

Required Qualifications :

- Bachelors degree in Computer Science, Information Technology, or a related technical field.

- 3+ years of hands-on experience in data engineering, with a focus on large-scale data processing and

cloud technologies.

- Strong expertise in Google Cloud Platform (GCP), particularly BigQuery, Cloud Composer, Cloud Storage, Dataflow, and Pub/Sub.

- Solid knowledge of SQL, Python, and scripting for automation and data manipulation.

- Practical experience with Apache Spark, Hadoop, or similar distributed computing frameworks.

- Familiarity with data modeling, warehousing concepts, and data pipeline orchestration.

- Understanding of data privacy, security, and governance in cloud environments.

- Excellent problem-solving skills and ability to work in a collaborative team environment.

Preferred Skills (Good to Have) :

- Experience with CI/CD pipelines and infrastructure-as-code tools (e.g., Terraform)

- Exposure to Airflow or Cloud Composer for orchestration

- Experience working in Agile development environments