Data Platform Engineer

Role & responsibilities

• Design and develop automation scripts for bi-directional data migration between AWS and GCP platforms
• Implement data migration strategies involving snapshot export/import, Change Data Capture (CDC), and logical replication
• Handle schema and data transformations between source and destination databases
• Develop and orchestrate workflows for the following migration scopes:
• RDS PostgreSQL / Aurora PostgreSQL Cloud SQL for PostgreSQL / AlloyDB
• Snapshot export/import, CDC via logical replication, schema/data transformation.
• RDS Microsoft SQL Server Cloud SQL for SQL Server
• Snapshot-based migration (full load) and CDC using native SQL Server replication tools.
• DynamoDB Cloud Bigtable / Firestore
• Export tables to S3, transform data, and import into appropriate GCP services based on use case
• Collaborate with data engineers, cloud architects, and DevOps teams to optimize migration pipelines
• Monitor and troubleshoot migration jobs, ensuring data integrity, consistency, and performance
• Document technical designs, migration procedures, and automation frameworks

Required Skills & Qualifications:

• Strong hands-on experience in AWS and GCP cloud platforms
• Proven expertise in PostgreSQL, Microsoft SQL Server, and NoSQL (DynamoDB, Firestore, Bigtable) databases
• Experience with data migration tools such as:
• AWS DMS, SCT, native replication tools
• GCP Database Migration Service, Dataflow, BigQuery Data Transfer Service
• Proficiency in automation/scripting languages: Python, Bash, Terraform, etc.
• Knowledge of Change Data Capture (CDC) and logical replication mechanisms
• Understanding of schema design, data modeling, and ETL pipelines
• Familiarity with snapshot-based backups and restores for RDS and Cloud SQL
• Strong problem-solving and troubleshooting skills

Preferred Qualifications

• Experience with CI/CD pipelines for data operations
• Familiarity with containerization tools (Docker, Kubernetes)
• Knowledge of data governance and security best practices during migration
• GCP and AWS certifications are a plus