Senior Data Engineer

ProArch

Data Engineer

Data Engineering

Data Migration

Oracle to PostgreSQL migration

AWS DMS (Database Migration Service)

Python

PySpark

Key Responsibilities:

• Lead and execute data migration initiatives, specifically from Oracle to PostgreSQL
• Design, develop, and implement AWS DMS solutions to migrate databases
• Collaborate with cross-functional teams to understand data requirements and ensure smooth migration processes
• Develop and optimize data pipelines using Python and PySpark
• Troubleshoot migration issues and implement corrective actions to ensure minimal disruptions during data transfer
• Ensure data integrity, accuracy, and quality throughout the migration process
• Create and maintain detailed documentation for migration processes, workflows, and data transformations
• Stay up to date with the latest technologies, best practices, and tools in data engineering and migration
  

Requirements

Requirements

• 5+ years of experience in the IT Industry, with a focus on Data Engineering
• Strong hands-on experience with Oracle to PostgreSQL migrations
• Expertise in using AWS DMS (Database Migration Service) for seamless data migration
• Proficient in Python and PySpark, with a strong understanding of data engineering concepts and data pipeline development
• Solid understanding of database architecture, SQL, and data modeling
• Experience in troubleshooting, optimizing, and scaling data migration workflows
• Ability to work independently and in a team environment with strong problem-solving skills
• Excellent written and verbal communication skills
  

Preferred Qualifications:

• Experience with other AWS services such as AWS Lambda, S3, and Redshift is a plus
• Familiarity with other database migration tools and technologies
• Certifications in AWS or other relevant data engineering domains