11 Airflow Dags Jobs

Job Description At American Express, our culture is built on a 175-year history of innovation, shared and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. How will you make an impact in this role Develop software and work on coding assignments. Function as member of an agile team by contributing to software ...

Job Title: Senior GCP Data Engineer Experience: 712 Years Location: Chennai, Bangalore, Hyderabad, Pune (Hybrid) Timings: Full Time (As per company timings) Notice Period: Immediate Joiner Only Job Overview We are seeking a seasoned Senior GCP Data Engineer with strong experience in building, optimizing, and maintaining large-scale data processing systems on Google Cloud Platform. The ideal candidate should be hands-on with BigQuery , DataProc (PySpark) , and workflow management using Airflow DAGs . Experience with Informatica is an added advantage. This role requires a proactive individual who can work independently as well as collaborate effectively within a team. Key Responsibilities Desi...

Job Location : Pune & Bangalore Experience Required : 5-8 yrs Required Skills & Qualifications Bachelor's or Master's degree in Computer Science, Data Engineering, or related field. Strong hands-on experience in testing batch and streaming data pipelines . Expertise with BigQuery or equivalent (Redshift, Synapse, etc.). Experience with Snowflake , Looker , or similar analytics systems on AWS or Azure . Advanced SQL skills joins, window functions, CTEs, query optimization, and complex validation queries. Solid knowledge of Python for data validation and test automation. Experience working with Airflow DAGs and data orchestration frameworks. Proven experience in data modeling , synthetic data ...

JD : Job Location : Pune & Bangalore Experience Required : 8-11 yrs. Required Skills & Qualifications Bachelor's or Master's degree in Computer Science, Data Engineering, or related field. Strong hands-on experience in testing batch and streaming data pipelines . Expertise with BigQuery or equivalent (Redshift, Synapse, etc.). Experience with Snowflake , Looker , or similar analytics systems on AWS or Azure . Advanced SQL skills joins, window functions, CTEs, query optimization, and complex validation queries. Solid knowledge of Python for data validation and test automation. Experience working with Airflow DAGs and data orchestration frameworks. Proven experience in data modeling , syntheti...

Some Careers Have More Impact Than Others. If you're looking for a career where you can make a real impression, join HSBC and discover how valued you'll be. HSBC is one of the largest banking and financial services organisations in the world, with operations in 62 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions. We are currently seeking an experienced professional to join our team in the role of Senior Analyst Decision Sciences Business: Wealth & Personal Banking Principal Responsibilities Support the definition and design of Decision Systems ...

Pipeline Design & Development Design, build, and maintain data ingestion and transformation pipelines using MWAA (Apache Airflow) and AWS Redshift. Develop Airflow DAGs to orchestrate data extraction from diverse sources (e.g., Oracle EBS, APIs, flat files, or S3). Implement transformation logic using SQL, Python, or Redshift stored procedures to curate data for analytical consumption. Create and manage staging, curated, and semantic data layers in Redshift aligned with the Medallion architecture principles. Integrate data ingestion pipelines with AWS services (e.g., S3, Glue, Lambda, Secrets Manager Performance, Optimization & Maintenance Tune Redshift queries and schema for high performanc...

As a Data Engineering professional, your role will involve monitoring data health for Tune-In & Local reports, investigating data integrity issues, troubleshooting DAG execution, documenting fixes and best practices, and providing on-call support for TV schedule partner feeds. Your primary technology focus will be on Data Ops, Tech Support, or Reporting QA, with proficiency in Snowflake, Airflow (DAGs), Python, and SQL. It is essential to have troubleshooting, documentation, and organizational skills, along with excellent communication abilities. Key Responsibilities: - Monitor data health for Tune-In & Local reports - Investigate data integrity issues and escalate bugs - Troubleshoot DAG ex...

Position: Managed Airflow Platform (MAP) support engineering Company :-Kloud 9 Availability: Immediate Exp - 3 -5 Years Shift Time ( 7 PM - 7 AM ) 2 shifts. Skills - Airflow, AWS, Python, Kubernetes After 2 months, candidates will get remote opportunities Scope and Responsibilities: As a Senior Engineer with a focus on Managed Airflow Platform (MAP) support engineering, you will: Evangelize and cultivate adoption of Global Platforms, open-source software and agile principles within the organization Ensure solutions are designed and developed using a scalable, highly resilient cloud native architecture Ensure the operational stability, performance, and scalability of cloud-native platforms th...

hiring a Data Operations Engineer for a 6-month contractual role based in Pune. The ideal candidate should have 5-9 years of experience in Data Operations, Technical Support, or Reporting QA. You will be responsible for monitoring data health, validating config payloads, troubleshooting Airflow DAGs, documenting best practices, and supporting Ad Tech partner integrations. Proficiency in Snowflake, Airflow, Python scripting, and SQL is mandatory. Excellent communication, problem-solving skills, and a proactive attitude are essential for success in this role.

Job description Some careers shine brighter than others. If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions. We are currently seeking an experienced professional to...

hiring a Data Operations Engineer for a 6-month contractual role based in Pune. The ideal candidate should have 5-9 years of experience in Data Operations, Technical Support, or Reporting QA. You will be responsible for monitoring data health, validating config payloads, troubleshooting Airflow DAGs, documenting best practices, and supporting Ad Tech partner integrations. Proficiency in Snowflake, Airflow, Python scripting, and SQL is mandatory. Excellent communication, problem-solving skills, and a proactive attitude are essential for success in this role.