10863 Airflow Jobs - Page 21

Company Description It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today — ServiceNow stands as a global market leader, bringing innovative AI-enhanced technology to over 8,100 customers, including 85% of the Fortune 500®. Our intelligent cloud-based platform seamlessly connects people, systems, and processes to empower organizations to find smarter, faster, and better ways to work. But this is just the beginning of our journey. Join us as we pursue our purpose to make the world work better for everyone. Job Description What you get to do in this role: Maintain existing automation test f...

Python Developer - Airflow, Node.js, Microsoft Azure App Service, PostgreSQL, MySQL, Celery and RabbitMQ Experience: 7+ years of experience in development or related fields. Technical Skills: Proficiency in Python, Airflow, along with JavaScript, and frameworks or libraries like NodeJS, and familiarity with databases like MySQL, PostgreSQL, or MongoDB building microservices/APIs, backend work, AZURE!, exposure to GenAI and vector DBs a plus). Understanding of Architecture: Comprehensive understanding of multiple back-end processes, and experience in API design and development. Version Control/Git: Experience in version control systems like Git is essential for tracking changes in code during...

Must have 10+ years of IT experience 5+ years of experience in developing data engineering solutions on Azure Good understanding of cloud services related to Data on Azure Hands-on experience in building data ingestion, data quality, real-time and batch processes with SQLs, Azure Data Factory, PySpark Experience on the platforms like Synapse, Databricks, Snowflake Experience in working on projects related to migration to cloud, data lake/lake house development Very Good communication skills Data Engineering related certification on Azure Good to have Understanding of other cloud services of AWS, GCP Experience in data modeling for data warehouses PoC execution experience in Microsoft Fabric ...

10+ years of IT experience 5+ years of experience in developing data engineering solutions on Azure Good understanding of cloud services related to Data on Azure Hands-on experience in building data ingestion, data quality, real-time and batch processes with SQLs, Azure Data Factory, PySpark Experience on the platforms like Synapse, Databricks, Snowflake Experience in working on projects related to migration to cloud, data lake/lake house development Very Good communication skills Data Engineering related certification on Azure Good to have Understanding of other cloud services of AWS, GCP Experience in data modeling for data warehouses PoC execution experience in Microsoft Fabric Experience...

10+ years of IT experience 5+ years of experience in developing data engineering solutions on Azure Good understanding of cloud services related to Data on Azure Hands-on experience in building data ingestion, data quality, real-time and batch processes with SQLs, Azure Data Factory, PySpark Experience on the platforms like Synapse, Databricks, Snowflake Experience in working on projects related to migration to cloud, data lake/lake house development Very Good communication skills Data Engineering related certification on Azure Good to have Understanding of other cloud services of AWS, GCP Experience in data modeling for data warehouses PoC execution experience in Microsoft Fabric Experience...

10+ years of IT experience 5+ years of experience in developing data engineering solutions on Azure Good understanding of cloud services related to Data on Azure Hands-on experience in building data ingestion, data quality, real-time and batch processes with SQLs, Azure Data Factory, PySpark Experience on the platforms like Synapse, Databricks, Snowflake Experience in working on projects related to migration to cloud, data lake/lake house development Very Good communication skills Data Engineering related certification on Azure Good to have Understanding of other cloud services of AWS, GCP Experience in data modeling for data warehouses PoC execution experience in Microsoft Fabric Experience...

Must have 10+ years of IT experience 5+ years of experience in developing data engineering solutions on Azure Good understanding of cloud services related to Data on Azure Hands-on experience in building data ingestion, data quality, real-time and batch processes with SQLs, Azure Data Factory, PySpark Experience on the platforms like Synapse, Databricks, Snowflake Experience in working on projects related to migration to cloud, data lake/lake house development Very Good communication skills Data Engineering related certification on Azure Good to have Understanding of other cloud services of AWS, GCP Experience in data modeling for data warehouses PoC execution experience in Microsoft Fabric ...

To ensure successful initiation, planning, execution, control and completion of the project by guiding team members on technical aspects, conducting reviews of technical documents and artefacts. Lead project development, production support and maintenance activities. Fill and ensure timesheets are completed, as is the invoicing process, on or before the deadline. Lead the customer interface for the project on an everyday basis, proactively addressing any issues before they are escalated. Create functional and technical specification documents. Track open tickets/ incidents in queue and allocate tickets to resources and ensure that the tickets are closed within the deadlines. Ensure analysts ...

Roles and Responsibilities The candidate will have experience with automation and monitoring of cloud based applications using tools and technologies such as Jenkins, Salt, JIRA, Git, Docker and Kubernetes across a range of platforms including Windows, Linux, Solaris, and AIX. Desired Candidate Profile

This role is responsible for developing, maintaining and optimizing data pipelines, delivering data timely to our cross-functional teams and support reporting and analytics. About the Role The Engineer will work closely with product partner, data analyst, report developers, architects, data scientists and other engineers on data initiatives and will be involved in designing our next generation of data platform architecture to support increasing data demands. Responsibilities Design, build and maintain scalable and reliable data pipelines to process large volumes of structures, semi-structured and un-structured data from diverse sources. Develop ETL processes to ingest, transform and load dat...

Role: Data Analyst Industry: Fintech, AI Location: Bangalore (Hybrid) Type: Full-time Experience: 2-5 years About the compan yThe company is an early-stage, venture-backed, AI-first finance technology company redefining how high-volume businesses run their finance operations. Instead of stitching together legacy, manual tools, it is building an intelligent finance operating system that centralizes data, automates reconciliation, streamlines payouts and collections, and delivers real-time result s Role Overvi ewOwn complex SQL: write, review, and optimize queries across large, sometimes messy datasets (billions of rows) for analysis and production us e.Build reliable data pipelines and analys...

Job Title: Software Engineer -Data Engineer Position: Software Engineer Experience: 4-6 years (Less YOE will be Rejected) Category: Software Development/ Engineering Shift Timings: 1:00 pm to 10:00 pm Main location: Hyderabad Work Type: Work from office Notice Period: 0-30 Days Skill: Python, Pyspark, Data Bricks Employment Type: Full Time • Bachelor's in Computer Science, Computer Engineering or related field Required qualifications to be successful in this role Must have Skills: • 3+ yrs. Development experience with Spark (PySpark), Python and SQL. • Extensive knowledge building data pipelines • Hands on experience with Databricks Devlopment • Strong experience with • Strong experience dev...

Job Title: Software Engineer -Data Engineer Position: Software Engineer Experience: 4-9 years Category: Software Development/ Engineering Shift Timings: 1:00 pm to 10:00 pm Main location: Hyderabad Work Type: Work from office Notice Period: 0-30 Days Skill: Python, Pyspark, Data Bricks Employment Type: Full Time • Bachelor's in Computer Science, Computer Engineering or related field Required qualifications to be successful in this role Must have Skills: • 3+ yrs. Development experience with Spark (PySpark), Python and SQL. • Extensive knowledge building data pipelines • Hands on experience with Databricks Devlopment • Strong experience with • Strong experience developing on Linux OS. • Exper...

Job Title: Senior SDET (Software Development Engineer in Test) Experience: 10+ years Work Mode: Remote About the Role We are seeking a highly skilled Senior SDET with deep expertise in ETL testing, SQL, and Python programming . This role requires someone who can go beyond traditional testing by designing, developing, and maintaining robust test automation frameworks and scripts from scratch , ensuring the quality and reliability of complex data pipelines. Key Responsibilities Design, develop, and maintain automated test frameworks for ETL workflows and data validation. Validate complex ETL pipelines, data transformations, and integrations across multiple sources. Write and optimize complex S...

Location: Sector 63, Noida (WFO) Timings: Mon - Fri; 10:30 AM to 7:30 PM About the Role We are seeking a skilled Data Engineer with hands-on experience in building and maintaining scalable data pipelines and analytics solutions. The ideal candidate will be highly proficient in PySpark and Data Build Tool (DBT), with strong experience in managing large datasets, data warehousing, and modern data stack technologies. Key Responsibilities Design, build, and maintain ETL/ELT pipelines for efficient data ingestion, transformation, and storage. Collaborate with data analysts, data scientists, and stakeholders to understand data requirements and deliver actionable solutions. Implement and maintain d...

We are looking for a skilled Senior Cloud Engineer with 5-7 years of experience in the field. The ideal candidate will have expertise in GCP, SQL, BQ, Python, and Airflow. Roles and Responsibility Develop and implement technical solutions for specific technology areas using GCP, SQL, BQ, Python, and Airflow. Deliver high-quality work autonomously and independently. Collaborate with cross-functional teams to design and implement cloud-based solutions. Ensure seamless integration of cloud services with existing infrastructure. Troubleshoot and resolve complex technical issues related to cloud services. Stay updated with the latest trends and technologies in cloud computing. Job Requirements St...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Manager Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and data trans...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Type: Contract Description: GCPdata engineer Big Query SQL Python Talend ETL ProgrammerGCPor Any Cloud technology. Experienced in GCP data engineer Big Query SQL Python Talend ETL Programmer GCPor Any Cloud technology. Good experience in building the pipeline of GCP Components to load the data into Big Query and to cloud storage buckets. Excellent Data Analysis skills. Good written and oral communication skills Self-motivated able to work independently

Skill:Data Engineer Notice Period:Immediate. Employment Type: Contract Job Description : Experience in Cloud platform, e.g., AWS, GCP, Azure, etc. Experience in distributed technology tools, viz. SQL, Spark, Python, PySpark, Scala Performance Turing Optimize SQL, PySpark for performance Airflow workflow scheduling tool for creating data pipelines GitHub source control tool & experience with creating/ configuring Jenkins pipeline Experience in EMR/ EC2, Databricks etc. DWH tools incl. SQL database, Presto, and Snowflake Streaming, Serverless Architecture .

Should have 6+ years of exp in Apache Superset for data exploration and visualisation exp in Apache Beam and Flink for data pipelineETL exp in Apache Airfow DAGS (collection of executions task) Good to have knowledge in any SQL/Mongo DB/Postgress

Expedia Group brands power global travel for everyone, everywhere. We design cutting-edge tech to make travel smoother and more memorable, and we create groundbreaking solutions for our partners. Our diverse, vibrant, and welcoming community is essential in driving our success. Why Join Us? To shape the future of travel, people must come first. Guided by our Values and Leadership Agreements, we foster an open culture where everyone belongs, differences are celebrated and know that when one of us wins, we all win. We provide a full benefits package, including exciting travel perks, generous time-off, parental leave, a flexible work model (with some pretty cool offices), and career development...

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together. Primary Responsibilities: Product Strategy & Roadmap: Define and maintain a technically sound product roadmap align...

About Chubb Chubb is a world leader in insurance. With operations in 54 countries and territories, Chubb provides commercial and personal property and casualty insurance, personal accident and supplemental health insurance, reinsurance and life insurance to a diverse group of clients. The company is defined by its extensive product and service offerings, broad distribution capabilities, exceptional financial strength and local operations globally. Parent company Chubb Limited is listed on the New York Stock Exchange (NYSE: CB) and is a component of the S&P 500 index. Chubb employs approximately 40,000 people worldwide. Additional information can be found at: www.chubb.com. About Chubb India ...