Job
Description
As a Senior Cloud Infrastructure Engineer specializing in Google Cloud Platform (GCP) and Terraform, your main responsibility will be to automate infrastructure creation on GCP using Terraform. You will play a crucial role in provisioning and setting up GCP projects and environments for the entire GCP data engineering stack, including services like BigQuery, DataFlow, Pub/Sub, and GCP DataStream. Additionally, your expertise in configuring pipelines using Azure DevOps to automate and manage the infrastructure provisioning process will be essential for this role. - Automate GCP Infrastructure: Design and implement Terraform scripts to provision and automate GCP projects, environments, and data engineering services. - Set Up Infrastructure for GCP DataStream: Configure and deploy the infrastructure for GCP DataStream to support real-time data replication and Change Data Capture (CDC) from on-prem databases like Oracle and DB2 to BigQuery. - Provision and Manage the GCP Data Engineering Stack: Set up and optimize infrastructure for BigQuery, Dataflow, Pub/Sub, Cloud Storage, and other data engineering tools on GCP. - Automate Infrastructure Pipelines with Azure DevOps: Design, develop, and maintain CI/CD pipelines using Azure DevOps to automate the deployment of Terraform scripts and manage infrastructure changes. - Optimize Cloud Infrastructure: Ensure high availability, scalability, and security for cloud resources and data pipelines. - Security and Compliance: Implement best practices for security and compliance across GCP environments, including IAM policies, encryption, and network security. - Collaboration: Work closely with data engineers and DevOps teams to align infrastructure with data pipelines and operational requirements. - 5+ years of experience in GCP infrastructure automation using Terraform to provision cloud resources and environments. - Experience with GCP DataStream: Proven ability to set up and configure GCP DataStream for real-time data replication and Change Data Capture (CDC) from on-prem databases (Oracle, DB2) to BigQuery. - Strong expertise in GCP data engineering services: Hands-on experience with BigQuery, Dataflow, Pub/Sub, Cloud Storage, and related GCP services. - Infrastructure Automation: Proficiency in creating reusable Terraform modules and automating cloud infrastructure using Terraform. - Experience with Azure DevOps: Expertise in configuring and maintaining CI/CD pipelines for infrastructure provisioning using Azure DevOps. - Networking and Security: Strong understanding of GCP networking, IAM, VPCs, firewall configurations, and security best practices. - Familiarity with on-prem databases such as Oracle and DB2. - Scripting and Automation: Proficiency in scripting (e.g., Bash, Python) for cloud automation and troubleshooting. As a Senior Cloud Infrastructure Engineer specializing in Google Cloud Platform (GCP) and Terraform, your main responsibility will be to automate infrastructure creation on GCP using Terraform. You will play a crucial role in provisioning and setting up GCP projects and environments for the entire GCP data engineering stack, including services like BigQuery, DataFlow, Pub/Sub, and GCP DataStream. Additionally, your expertise in configuring pipelines using Azure DevOps to automate and manage the infrastructure provisioning process will be essential for this role. - Automate GCP Infrastructure: Design and implement Terraform scripts to provision and automate GCP projects, environments, and data engineering services. - Set Up Infrastructure for GCP DataStream: Configure and deploy the infrastructure for GCP DataStream to support real-time data replication and Change Data Capture (CDC) from on-prem databases like Oracle and DB2 to BigQuery. - Provision and Manage the GCP Data Engineering Stack: Set up and optimize infrastructure for BigQuery, Dataflow, Pub/Sub, Cloud Storage, and other data engineering tools on GCP. - Automate Infrastructure Pipelines with Azure DevOps: Design, develop, and maintain CI/CD pipelines using Azure DevOps to automate the deployment of Terraform scripts and manage infrastructure changes. - Optimize Cloud Infrastructure: Ensure high availability, scalability, and security for cloud resources and data pipelines. - Security and Compliance: Implement best practices for security and compliance across GCP environments, including IAM policies, encryption, and network security. - Collaboration: Work closely with data engineers and DevOps teams to align infrastructure with data pipelines and operational requirements. - 5+ years of experience in GCP infrastructure automation using Terraform to provision cloud resources and environments. - Experience with GCP DataStream: Proven ability to set up and configure GCP DataStream for real-time data replication and Change Data Capture (CDC) from on-prem databases (Oracle, DB2) to BigQuery. - Strong expertise in GCP data engineering services: Hands-on experience with BigQuery, Dataflow, Pub
