Role Overview : Seeking an experienced Apache Airflow specialist to design and manage data orchestration pipelines for batch/streaming workflows in a Cloudera environment. Key Responsibilities : Design, schedule, and monitor DAGs for ETL/ELT pipelines Integrate Airflow with Cloudera services and external APIs Implement retries, alerts, logging, and failure recovery Collaborate with data engineers and DevOps teams Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise Skills Required : Experience 3–8 years Expertise in Airflow 2.x, Python, Bash Knowledge of CI/CD for Airflow DAGs Proven experience with Cloudera CDP, Spark/Hive-based data pipelines Integration with Kafka, REST APIs, databases

More Jobs at IBM

IBM - Hiring For Process and Sr. Process Analyst (TM/ AML)

Bengaluru

1 - 3 yrs

INR 4 - 7 Lacs

Backend Developer

Bengaluru

1 - 3 yrs

INR 3 - 7 Lacs

Data Engineer-Data Platforms-AWS

Bengaluru

2 - 6 yrs

INR 12 - 16 Lacs

Data Engineer-Data Platforms

Hyderabad

6 - 9 yrs

INR 14 - 17 Lacs

Advisory AI Engineer

Bengaluru

1 - 5 yrs

INR 10 - 14 Lacs

Mock Interview

Practice Video Interview with JobPe AI

Start Continuous Integration Interview Now

My Connections IBM

Download Chrome Extension (See your connection in the IBM )

Download Now

IBM

www.ibm.com

Information Technology

Armonk

350,000 Employees

6362 Jobs

Key People

Arvind Krishna

Chairman and Chief Executive Officer
Ginni Rometty

Former Chairman, President and CEO
James Kavanaugh

Chief Financial Officer
David Ferdinand

Senior Vice President, Corporate Strategy

Login to

Please Verify Your Phone or Email

Confirm Action

Search

Profile

Bookmarks

Data Engineer-Apache Airflow