Lead I - Airflow Migration Developer

6 - 10 years

0 Lacs

Posted:3 weeks ago| Platform: Shine logo

Apply

Work Mode

On-site

Job Type

Full Time

Job Description

Role Overview: As an experienced Airflow Migration Developer, you will be responsible for leading the migration of job scheduling processes from Autosys to Apache Airflow. Your role will involve analyzing existing job definitions, designing and implementing equivalent Apache Airflow DAGs, integrating Airflow with downstream systems, and collaborating with cloud engineering and application teams for successful deployment in AWS environments. Your focus will be on ensuring a seamless transition, robust scheduling, and high availability in production environments. Key Responsibilities: - Analyze existing Autosys job definitions, dependencies, and workflows. - Design and implement equivalent Apache Airflow DAGs to maintain or improve scheduling efficiency and SLAs. - Integrate Airflow with MarkitEDM and other downstream systems. - Ensure proper logging, monitoring, and alignment with SLAs and operational standards. - Collaborate with cloud engineering and application teams to deploy workflows in AWS environments (e.g., ECS, Lambda). - Create detailed documentation for migration logic, configurations, and operational runbooks. - Support User Acceptance Testing (UAT) and manage production rollout activities. Qualifications Required: - Strong hands-on experience with Apache Airflow, including DAG design and scheduling. - Proficient with Autosys job scheduling and batch job management. - Proficiency in Python for scripting and workflow orchestration. - Solid experience with AWS services: ECS, S3, Lambda, CloudWatch. - Familiarity with MarkitEDM or similar data management platforms. - Knowledge of CI/CD pipelines and DevOps practices. - Strong debugging, problem-solving, and performance tuning skills. - Excellent communication and documentation capabilities. Additional Details about UST: UST is a global digital transformation solutions provider with a deep domain expertise and a future-proof philosophy. With over 30,000 employees in 30 countries, UST partners with clients from design to operation, embedding innovation and agility into their organizations to make a real impact through transformation.,

Mock Interview

Practice Video Interview with JobPe AI

Start Python Interview
cta

Start Your Job Search Today

Browse through a variety of job opportunities tailored to your skills and preferences. Filter by location, experience, salary, and more to find your perfect fit.

Job Application AI Bot

Job Application AI Bot

Apply to 20+ Portals in one click

Download Now

Download the Mobile App

Instantly access job listings, apply easily, and track applications.

coding practice

Enhance Your Python Skills

Practice Python coding challenges to boost your skills

Start Practicing Python Now
UST Global logo
UST Global

Information Technology Services

Oxnard

RecommendedJobs for You