Senior Cloud Migration Engineer ( EMR Serverless)

Position Summary

We are seeking a highly skilled Senior Cloud Migration Engineer to lead the transformation of our EMR workloads from EC2-based infrastructure to EMR Serverless. This strategic role focuses on enhancing scalability, reducing operational overhead, and improving cost efficiency across our cloud-native data processing platform.

______________

Key Responsibilities

Migration Planning & Assessment

* Analyze existing EC2-based EMR jobs to assess their suitability for serverless migration

* Prioritize workloads based on business impact, complexity, and readiness

* Conduct deep code discovery and ensure alignment with production standards

* Audit and synchronize code repositories with live production environments

Technical Implementation

* Transition Hadoop/HDFS workloads to Amazon S3-based architectures

* Refactor data processing pipelines to leverage Amazon Athena

* Upgrade and modernize runtime environments (e.g., Python versions)

* Ensure full dependency compatibility across target serverless stacks

Infrastructure Modernization

* Integrate EMR Serverless logging with AWS CloudWatch

* Configure centralized logging via AWS Log Groups

* Optimize workflows for observability and performance in a serverless model

* Migrate legacy scheduling (e.g., Control-M, cron) to AWS Step Functions

* DevOps - Git Hub and Workflow Experience

Quality Assurance & Deployment

* Design and implement robust testing strategies across staging and QA environments

* Document test plans, validation procedures, and migration outcomes

* Collaborate with the AMI and QA teams for pre-deployment sign-offs

* Execute controlled production rollouts with post-deployment monitoring

______________

Required Qualifications

* 5+ years of experience with Amazon EMR and big data platforms

* Deep expertise in Apache Spark, Hadoop ecosystem, and AWS cloud services

* Proficient in Python and version management

* Hands-on experience with AWS Step Functions, CloudWatch, and serverless solutions

* Familiarity with job schedulers like Control-M or cron

* Strong knowledge of Amazon S3, Athena, and data lake architectures

______________

Preferred Qualifications

* AWS Certifications (Solutions Architect, DevOps Engineer, or Data Analytics)

* Experience with Infrastructure as Code (IaC) tools such as CloudFormation or Terraform

* Proven success in enterprise-scale cloud/data migration projects

* Experience working in Agile environments using JIRA or similar tools

______________

Success Metrics

* Full migration of selected EMR jobs to EMR Serverless

* Meet or exceed existing EC2-based performance benchmarks

* Demonstrable cost savings post-migration

* Zero data loss throughout the migration process

* Successful completion of quality checks and stakeholder approvals