72 Airflow Jobs

Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology. Your Role And Responsibilities Design, implement, and manage large-scale data processing systems using Big Data Technologies such as Hadoop, Apache Spark, and Hive. Develop and manage our database infrastructure based on Relational Database Management Systems (RDBMS), with strong expertise in SQL. Utilize scheduling tools ...

Project description Provide consultative Business and System Integration services to help clients implement effective solutions in Wealth Management Team. Responsibilities Monitor data pipelines, workflows and applications across snowflake, Airflow, DBT. Triage incidents, perform impact assessment and drive rapid mitigation. Diagnose app issues via logs, metrics and traces, Debug SQL queries, stored procedures, pipelines to resolve errors in data processing. Perform health checks, validations and reconciliations of data sets for accuracy and completeness. Executes the remediations following the SOPs, runbooks, knowledge base articles etc. Skills Must have 6 -10 years of experience in Softwar...

Req ID: 356261 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Software Development Advisor to join our team in Noida or other NTT location, Uttar Pradesh (IN-UP), India (IN). Data Engineer: 8+ years of very good hands-on experience in AWS Redshift (Data Loading experience mandatory into Redshift), with ETL experience Data Modelling and SQL stored procedures OCI ADW skills (good to have) Python (basic knowledge) Experience working in agile teams Airflow (good to have) Kafka or message queues in general (good to have)...

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. EY GDS – Data and Analytics (D&A) – AWS Data Engineer with Databricks As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insur...

As a Data Engineer, you will be responsible for designing and developing data pipelines using various technologies. Your key responsibilities will include: - Hands-on Experience with programming languages such as Python is mandatory. - Thorough understanding of AWS from a data engineering and tools standpoint. Experience in another cloud is also beneficial. - Experience in AWS Glue, Spark, and Python with Airflow for designing and developing data pipelines. Expertise in Informatica Cloud is advantageous. - Data Modeling: Advanced/Intermediate Data Modeling skills (Master/Ref/ODS/DW/DM) to enable Analytics on the Platform. - Traditional data warehousing and ETL skillset, including strong SQL ...

You will be responsible for reviewing, optimizing, and tuning data ingestion and extraction pipelines orchestrated by Airflow. Additionally, you will develop frameworks to manage and engineer a large number of pipelines for the entire domain. You will be expected to build architecture, data flow, and operational diagrams and documents with detailed physical and logical layers. Providing reference implementations of various activities, including composing data pipelines in Airflow, implementing new Airflow features, or integrating Airflow with 3rd party solutions is also part of your role. Keeping up with the latest Astro and Airflow features to better advise on impactful improvements is cruc...

SENIOR DATA ENGINEER (SQL + SNOWFLAKE) Role Overview The Senior Data Engineer will lead the design, development, and optimization of enterprise-scale data pipelines and analytical data models primarily within Snowflake and modern cloud data platforms. This role is highly SQL-driven , with accountability for performance, reliability, and data architecture decisions. The engineer will partner closely with data architects, analysts, product teams, and business stakeholders to deliver governed, scalable, and analytics-ready data solutions while mentoring junior engineers. Core Responsibilities Architect, develop, and optimize complex SQL-based data pipelines and transformations in Snowflake. Lea...

Introduction In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology Your Role And Responsibilities Create Solution Outline and Macro Design to describe end to end product implementation in Data Platforms including, System integration, Data ingestion, Data processing, Serving layer, Design Patterns, Platform Architecture Principles for Data platform Contribute to pre-sales, sales support thr...

Experience : 4.00 + years Salary : Confidential (based on experience) Expected Notice Period : 30 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Indefinite Contract(40 hrs a week/160 hrs a month) (*Note: This is a requirement for one of Uplers' client - FC) What do you need for this opportunity? Must have skills required: AI/ML, Airflow, Cloud Infrastructure, react, Database, FullStack, Next Js, Python, Redis FC is Looking for: This is a US is based organisation which is building next-generation, AI-native finance and accounting infrastructure for enterprises. Our mission is to fundamentally rethink how financial systems are built, operated, ...

Experience : 4.00 + years Salary : Confidential (based on experience) Expected Notice Period : 30 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Indefinite Contract(40 hrs a week/160 hrs a month) (*Note: This is a requirement for one of Uplers' client - FC) What do you need for this opportunity? Must have skills required: AI/ML, Airflow, Cloud Infrastructure, react, Database, FullStack, Next Js, Python, Redis FC is Looking for: This is a US is based organisation which is building next-generation, AI-native finance and accounting infrastructure for enterprises. Our mission is to fundamentally rethink how financial systems are built, operated, ...

Experience : 4.00 + years Salary : Confidential (based on experience) Expected Notice Period : 30 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Indefinite Contract(40 hrs a week/160 hrs a month) (*Note: This is a requirement for one of Uplers' client - FC) What do you need for this opportunity? Must have skills required: AI/ML, Airflow, Cloud Infrastructure, react, Database, FullStack, Next Js, Python, Redis FC is Looking for: This is a US is based organisation which is building next-generation, AI-native finance and accounting infrastructure for enterprises. Our mission is to fundamentally rethink how financial systems are built, operated, ...

Job Title - Retail Specialized Data Scientist Level 9 SnC GN Data AI Management Level:09 - Consultant Location:Bangalore / Gurgaon / Mumbai / Chennai / Pune / Hyderabad / Kolkata Must have skills: A solid understanding of retail industry dynamics, including key performance indicators (KPIs) such as sales trends, customer segmentation, inventory turnover, and promotions. Strong ability to communicate complex data insights to non-technical stakeholders, including senior management, marketing, and operational teams. Meticulous in ensuring data quality, accuracy, and consistency when handling large, complex datasets. Gather and clean data from various retail sources, such as sales transactions, ...

Job Title - Retail Specialized Data Scientist – Level 9 – SnC GN Data & AI Management Level: 09 - Consultant Location: Bangalore / Gurgaon / Mumbai / Chennai / Pune / Hyderabad / Kolkata Must have skills: A solid understanding of retail industry dynamics, including key performance indicators (KPIs) such as sales trends, customer segmentation, inventory turnover, and promotions. Strong ability to communicate complex data insights to non-technical stakeholders, including senior management, marketing, and operational teams. Meticulous in ensuring data quality, accuracy, and consistency when handling large, complex datasets. Gather and clean data from various retail sources, such as sales transa...

Experience : 3.00 + years Salary : INR 4000000-4500000 / year (based on experience) Expected Notice Period : 30 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Ellipse) (*Note: This is a requirement for one of Uplers' client - Ellipse) What do you need for this opportunity? Must have skills required: maintainable pipelines. ? Great communication and documentation habits. ? Interest in sports analytics (particularly cricket)., Understanding of the ML lifecycle and MLOps concepts. ? Experience with Docker; cloud experience (AWS/GCP). ? Strong problem-solving skills and ability to build ...

Experience : 3.00 + years Salary : INR 4000000-4500000 / year (based on experience) Expected Notice Period : 30 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Ellipse) (*Note: This is a requirement for one of Uplers' client - Ellipse) What do you need for this opportunity? Must have skills required: maintainable pipelines. ? Great communication and documentation habits. ? Interest in sports analytics (particularly cricket)., Understanding of the ML lifecycle and MLOps concepts. ? Experience with Docker; cloud experience (AWS/GCP). ? Strong problem-solving skills and ability to build ...

Experience : 3.00 + years Salary : INR 4000000-4500000 / year (based on experience) Expected Notice Period : 30 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Ellipse) (*Note: This is a requirement for one of Uplers' client - Ellipse) What do you need for this opportunity? Must have skills required: maintainable pipelines. ? Great communication and documentation habits. ? Interest in sports analytics (particularly cricket)., Understanding of the ML lifecycle and MLOps concepts. ? Experience with Docker; cloud experience (AWS/GCP). ? Strong problem-solving skills and ability to build ...

Experience : 3.00 + years Salary : INR 4000000-4500000 / year (based on experience) Expected Notice Period : 30 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Ellipse) (*Note: This is a requirement for one of Uplers' client - Ellipse) What do you need for this opportunity? Must have skills required: maintainable pipelines. ? Great communication and documentation habits. ? Interest in sports analytics (particularly cricket)., Understanding of the ML lifecycle and MLOps concepts. ? Experience with Docker; cloud experience (AWS/GCP). ? Strong problem-solving skills and ability to build ...

Experience : 3.00 + years Salary : INR 4000000-4500000 / year (based on experience) Expected Notice Period : 30 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Ellipse) (*Note: This is a requirement for one of Uplers' client - Ellipse) What do you need for this opportunity? Must have skills required: maintainable pipelines. ? Great communication and documentation habits. ? Interest in sports analytics (particularly cricket)., Understanding of the ML lifecycle and MLOps concepts. ? Experience with Docker; cloud experience (AWS/GCP). ? Strong problem-solving skills and ability to build ...

Position Overview Job Title- Developer/Software Engineer, AS Location- Pune, India Role Description This role is for a Software Engineer responsible for design, development, and unit testing software applications. The candidate is expected to ensure good quality, maintainable, scalable, and high performing software applications are delivered to users in an Agile development environment. Candidate/Applicant should be coming from a strong technological background. The candidate should have experience working in Google Cloud Platform and components like App Engine, GKE, setting up data pipelines, Terraform in addition to Oracle 19C, PL/SQL, Unix, Airflow, Control-M, Python and/or Java. Should b...

Senior AI/ML Data Developer Primary Skills: AI/ML Snowflake Python PySpark Secondary: dbt Airflow SQL Key Responsibilities Design, develop, and maintain AI/ML-focused data pipelines using Python and PySpark Build scalable data processing and feature engineering pipelines for model training and inference Develop and optimize Snowflake-based data models to support AI/ML workloads and advanced analytics Implement PySpark jobs for large-scale data transformations and ML data preparation Collaborate with data scientists and ML engineers to operationalize AI/ML models Support the ML lifecycle, including data ingestion, feature generation, training, and inference pipelines Optimize performance and ...

Experience : 3.00 + years Salary : INR 3000000-3500000 / year (based on experience) Expected Notice Period : 7 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: A Series A funded California based Software Development Company) (*Note: This is a requirement for one of Uplers' client - A Series A funded California based Software Development Company) What do you need for this opportunity? Must have skills required: ETL/ELT pipelines, Python, APIs/webhooks, NoSQL databases, Mongo DB, Rest APIs, Prefect, Airflow, Dagster, Cron, Snowflake, BigQuery, Redshift A Series A funded California based ...

Experience : 3.00 + years Salary : INR 3000000-3500000 / year (based on experience) Expected Notice Period : 7 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: A Series A funded California based Software Development Company) (*Note: This is a requirement for one of Uplers' client - A Series A funded California based Software Development Company) What do you need for this opportunity? Must have skills required: ETL/ELT pipelines, Python, APIs/webhooks, NoSQL databases, Mongo DB, Rest APIs, Prefect, Airflow, Dagster, Cron, Snowflake, BigQuery, Redshift A Series A funded California based ...

Experience : 3.00 + years Salary : Confidential (based on experience) Expected Notice Period : 15 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Datalogz) (*Note: This is a requirement for one of Uplers' client - Datalogz) What do you need for this opportunity? Must have skills required: Power BI, SQL Alchemy Datalogz is Looking for: Sr Data Engineer Position Overview We are looking for a Data Engineer to join our growing engineering team and help shape the core data infrastructure that powers the Datalogz platform. You will be responsible for building and maintaining reliable, scala...

Senior AI/ML Data Developer Primary Skills: AI/ML Snowflake Python PySpark Secondary: dbt Airflow SQL Key Responsibilities Design, develop, and maintain AI/ML-focused data pipelines using Python and PySpark Build scalable data processing and feature engineering pipelines for model training and inference Develop and optimize Snowflake-based data models to support AI/ML workloads and advanced analytics Implement PySpark jobs for large-scale data transformations and ML data preparation Collaborate with data scientists and ML engineers to operationalize AI/ML models Support the ML lifecycle, including data ingestion, feature generation, training, and inference pipelines Optimize performance and ...

Experience : 5.00 + years Salary : Confidential (based on experience) Expected Notice Period : 15 Days Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full Time Permanent position(Payroll and Compliance to be managed by: Datalogz) (*Note: This is a requirement for one of Uplers' client - Datalogz) What do you need for this opportunity? Must have skills required: Spark, FastAPI, Docker, Python Datalogz is Looking for: Sr Backend Engineer Position Overview We are looking for a Backend Engineer to join our engineering team and help power the backbone of the Datalogz platform. You will be responsible for architecting and scaling our data ingestion, transformatio...