15348 Airflow Jobs - Page 18

Position Summary... What you'll do... About Team Data Engineering at Enterprise Business Services (EBS) enables Walmart's business and technology partners to unlock the power of data at scale. We design and build foundational data platforms and pipelines that fuel analytics, machine learning, and real-time decision-making across Walmart's global ecosystem. As a Senior Software Engineer Data Engineering, you will be part of a high-impact team that develops the next generation of enterprise-grade data solutions. Our engineers work in an agile environment, solving complex data problems and delivering highly reliable, secure, and scalable systems. You will design robust data architectures, optim...

Data Engineer REMOTE, INDIA Day to day: As a Data Engineer, you will design, build, and maintain data products such as pipelines, models, APIs, and visualizations using best-in-class tools and DataOps practices. Your role involves creating scalable solutions that integrate machine learning and AI capabilities, implementing software engineering standards like modular code, version control, automated testing, and CI/CD workflows. You'll work with orchestration tools like Airflow and transformation frameworks such as DBT on AWS to develop and optimize ETL/ELT pipelines, while ensuring data integration across disparate systems for end-to-end accessibility. Responsibilities include modeling and t...

Job Summary We are seeking an experienced GCP Data Engineer with strong expertise in designing, building, and managing scalable data pipelines and analytical solutions on Google Cloud Platform (GCP). The ideal candidate will have a solid background in big data technologies, data warehousing, and cloud-based data architecture, with hands-on experience using GCP-native tools. Key Responsibilities Design, develop, and maintain data pipelines and ETL processes on GCP using services like Dataflow, Dataproc, Pub/Sub, Cloud Functions, and Composer (Airflow). Build and optimize data warehouses and data lakes using BigQuery, Cloud Storage, and Cloud SQL. Collaborate with data analysts, data scientist...

It's an exciting time to be a builder. Constant technological advances are creating an exciting new world for those who understand the value of data. The mission of NIQs Media Division is to turn NIQ into the global leader that transforms how consumer brands plan, activate and measure their media activities. By combining technology and our extensive data assets on consumer purchases, interests, lifestyles, and media we allow advertisers to leverage outcomes to maximize their return on advertising spend. As a data engineer, you'll design and build robust data pipelines and architectures that power these insights. Key Responsibilities: Data Pipeline Development: Design, build, and maintain sca...

The Role We're looking for a Lead Analytics Engineer to take ownership of our analytics data Pipeline and play a pivotal role in designing and scaling our modern data stack. This is a hands-on technical leadership role where you'll shape the data models in dbt/ Snowflake , orchestrate pipelines using Airflow , and enable high-quality, trusted data for reporting. Key Responsibilities Lead the development and governance of DAZN's semantic data models to support consistent, reusable reporting metrics. Architect efficient, scalable data transformations on Snowflake using SQL/DBT and best practices in data warehousing. Manage and enhance pipeline orchestration with Airflow , ensuring timely and r...

Experience Range: 7 + Yrs Date of Interview: 21st Nov, 2025 Mode of Interview: Virtual (Teams) Roles and Responsibilities Design, develop, test, deploy, and maintain large-scale data pipelines using Airflow. Desired Candidate Profile 7-12 years of experience in designing and developing large-scale data pipelines using Airflow. Strong proficiency in Python programming language for building custom functions, operators, and tasks within Airflow DAGs. Experience working with relational databases such as PostgreSQL or MySQL for storing and retrieving large datasets. Proficiency in SQL querying languages like SQL for performing ad-hoc analysis on stored data.

Greetings from TCS! We are looking for Data Engineer Experience: 6 - 18 Years Location: Hyderabad Must-Have Job Expectations: Create and maintain optimal data pipeline architecture, Assemble large, complex data sets that meet functional / non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure required for optimal ingestion, transformation, and Publishing of data from a wide variety of data sources using Python/Spark and AWS ‘big data’ technologies. Build analytics tools that utilize the data pipeline to provide...

Expedia Group brands power global travel for everyone, everywhere. We design cutting-edge tech to make travel smoother and more memorable, and we create groundbreaking solutions for our partners. Our diverse, vibrant, and welcoming community is essential in driving our success. Why Join Us? To shape the future of travel, people must come first. Guided by our Values and Leadership Agreements, we foster an open culture where everyone belongs, differences are celebrated and know that when one of us wins, we all win. We provide a full benefits package, including exciting travel perks, generous time-off, parental leave, a flexible work model (with some pretty cool offices), and career development...

VP – Data Architect || 10–15 YOE || Delhi || 5 Days || Max NP 90 Days || Mandatory: 10+ YOE Data Engg + Large-Scale Data + Java/Python + Leadership Hiring for a B2B SaaS Product Company Delhi (Onsite, 5 Days) Role: VP – Data Architect We are looking for a super-strong Data Architect who has scaled high-load, data-heavy systems and led Data Engineering teams in modern product environments. Mandatory Criteria 10+ YOE with 6+ YOE in Data Engineering + 2+ years in leadership 7+ YOE hands-on coding (Java highly preferred / Python / Node.js / Go) Strong experience in HDFS, YARN, MapReduce, Hive, Kafka, Spark, Airflow, Presto Expertise in HLD & LLD , scalable architectures Must have led 5+ Data Eng...

We’re not just selling HVAC grills and diffusers. We’re building the future of air distribution - efficient, sustainable, and engineered for comfort. We’re looking for someone who can take that story to consultants, architects, and contractors - and turn conversations into long-term relationships. What you’ll actually do: Build a consistent sales pipeline by identifying upcoming projects, consultant specifications, and new opportunities in HVAC, commercial, and institutional segments. Engage with consultants, architects, and MEP contractors - understanding their project needs and positioning Goodwind’s products as the preferred choice. Convert drawings and BOQs into actionable sales — you’ll...

JOB BREIF: The Senior Project Engineer – HVAC leads the end-to-end planning, design, installation, and commissioning of HVAC systems for commercial, industrial, and residential projects. This role requires deep technical expertise, strong project execution capability, and the ability to manage multiple stakeholders with ease. Key Responsibilities Project Planning & Coordination Review HVAC designs, tender drawings, BOQs and specifications to ensure accuracy and feasibility. Coordinate with architects, structural engineers, electrical and plumbing teams to integrate HVAC systems with overall project design. Prepare HVAC work schedules, manpower planning and material forecasts in alignment wit...

Medidata Solutions is seeking a Senior DataOps Engineer to help scale and operate our next-generation clinical data platform. You will work closely with Data Engineering, Data Services and AI/ML teams to automate deployments, enhance observability, and ensure reliable operations for critical pipelines and services powering CTMS, EDC, and eTMF integrations. What You will Do Automate deployment and monitoring of Snowflake, Airflow, and S3/Iceberg pipelines across multiple environments. Build and maintain CI/CD workflows using GitHub Actions and infrastructure as code with Terraform. Deploy, operate, and scale Python and Java applications on AWS services, including Lambda, ECS, EKS, and Step Fu...

Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Apache Airflow Good to have skills : NA Minimum 5 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL pro...

Appnext offers end-to-end discovery solutions covering all the touchpoints users have with their devices. Thanks to Appnext’s direct partnerships with top OEM brands and carriers, user engagement is achieved from the moment they personalize their device for the first time and throughout their daily mobile journey. Appnext ‘Timeline’, a patented behavioral analytics technology, is uniquely capable of predicting the apps users are likely to need next. This innovative solution means app developers and marketers can seamlessly engage with users directly on their smartphones through personalized, contextual recommendations. Established in 2012 and now with 12 offices globally, Appnext is the fast...

Job Description We are seeking a skilled Data Engineer with over 5+ years of experience to design, build, and maintain scalable data pipelines and perform advanced data analysis to support business intelligence and data-driven decision-making. The ideal candidate will have a strong foundation in computer science principles, extensive experience with SQL and big data tools, and proficiency in cloud platforms and data visualization tools. Responsibilities Key Responsibilities: Exp: 5+ years Design, develop, and maintain robust, scalable ETL pipelines using Apache Airflow, DBT, Composer (GCP), Control-M, Cron, Luigi, and similar tools. Build and optimize data architectures including data lakes ...

Who We Are Escalent is an award-winning data analytics and advisory firm that helps clients understand human and market behaviors to navigate disruption. As catalysts of progress for more than 40 years, our strategies guide the world’s leading brands. We accelerate growth by creating a seamless flow between primary, secondary, syndicated, and internal business data, providing consulting and advisory services from insights through implementation. Based on a profound understanding of what drives human beings and markets, we identify actions that build brands, enhance customer experiences, inspire product innovation and boost business productivity. We listen, learn, question, discover, innovate...

Job Description We are seeking a skilled Data Engineer with over 5+ years of experience to design, build, and maintain scalable data pipelines and perform advanced data analysis to support business intelligence and data-driven decision-making. The ideal candidate will have a strong foundation in computer science principles, extensive experience with SQL and big data tools, and proficiency in cloud platforms and data visualization tools. Responsibilities Key Responsibilities: Exp: 5+ years Design, develop, and maintain robust, scalable ETL pipelines using Apache Airflow, DBT, Composer (GCP), Control-M, Cron, Luigi, and similar tools. Build and optimize data architectures including data lakes ...

Job Description We are seeking a skilled Data Engineer with over 5+ years of experience to design, build, and maintain scalable data pipelines and perform advanced data analysis to support business intelligence and data-driven decision-making. The ideal candidate will have a strong foundation in computer science principles, extensive experience with SQL and big data tools, and proficiency in cloud platforms and data visualization tools. Responsibilities Key Responsibilities: Exp: 5+ years Design, develop, and maintain robust, scalable ETL pipelines using Apache Airflow, DBT, Composer (GCP), Control-M, Cron, Luigi, and similar tools. Build and optimize data architectures including data lakes ...

Role Overview: As a Senior IT Data Analyst at Persistent Ltd., you will be responsible for performing data analysis for various data stores and supporting business intelligence/data warehouse methodologies. Your role will involve gathering business requirements, creating source-to-target mappings, developing scalable reporting processes, and ensuring data integrity. You will also be involved in research on complex data/analytical issues and providing end-to-end solutions for data issues in a production setting. Key Responsibilities: - Gather business requirements for analytical applications in an iterative/agile development model - Create source-to-target mapping and rules definitions based ...

Description We are looking for a hands-on, senior Snowflake expert who has both administrative and development experience in managing, securing, and optimizing large-scale Snowflake instances. The ideal candidate will be responsible for overseeing our Snowflake SaaS instance (purchased through AWS), integrating with tools such as Prefect, dbt, and Python-based data pipelines, and ensuring operational excellence, cost efficiency, and compliance. Key Responsibilities Snowflake Administration : Manage and maintain the Snowflake SaaS environment, including user roles, security, data sharing, and integrations. Monitor system performance and proactively tune configurations for optimal performance ...

Profile : Senior Data Engineer (Azure) Experience Required : 6+ Years Work Mode : Hybrid Location : Gurgaon, Pune, Jaipur, Bangalore, Bhopal Employment Type : Full-time About The Role We are seeking an experienced Senior Data Engineer with strong expertise in Microsoft Azure ecosystem to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining enterprise-scale data solutions on Azure, working with cutting-edge cloud technologies and big data platforms. Key Responsibilities Data Processing on Azure : Azure Data Factory, Streaming Analytics, Event Hubs, Azure Databricks, Data Migration Service, Data Pipeline. Provisioning, configuring, ...

Role Overview: You will be part of a Data Engineering team at Walmart's Enterprise Business Services (EBS) that is responsible for building and operating scalable, intelligent data platforms to enable analytics, automation, and AI-driven decision-making. The team's focus is on designing high-performance data systems, ensuring reliability, and integrating Generative AI capabilities to enhance data processing and utilization. The team culture emphasizes ownership, collaboration, technical craftsmanship, innovation, and delivery excellence. Key Responsibilities: - Architect Data & AI Systems at Scale: Design large-scale, distributed data architectures capable of processing massive datasets, int...

As an experienced Data Engineering professional with over 12 years of experience, you will be responsible for leading and driving strategic initiatives in the field. Your expertise in cloud data platforms such as Azure, AWS, or GCP will be crucial in this role. You will have a proven track record in data lake, data warehouse, and ETL/ELT architectures, with hands-on experience in tools like Databricks, Snowflake, Apache Spark, Kafka, and Airflow. Key Responsibilities: - Manage teams and strategic initiatives in a leadership or practice lead role. - Design and implement data architectures on cloud platforms. - Utilize tools such as Databricks, Snowflake, Apache Spark, Kafka, and Airflow for d...

Role Overview: As a Junior Dev Cloud Engineer, your main responsibility will be to design, develop, and deploy scalable data processing and orchestration solutions on Google Cloud Platform (GCP). You should have strong hands-on experience in Java 17+, Apache Beam, and Airflow/Cloud Composer, with exposure to GCP Big Data services. Key Responsibilities: - Design, develop, test, and deploy scalable and reliable data processing pipelines using Java 17+ and Apache Beam, executed on GCP Cloud Dataflow. - Build and manage data orchestration workflows using Apache Airflow or GCP Cloud Composer, including creating and maintaining DAGs with common and custom operators. - Work extensively with GCP Big...

Role Overview: You will be responsible for designing, building, and optimizing GenAI-enabled data pipelines, collaborating closely with data scientists, ML engineers, and platform teams to operationalize AI-driven reasoning, contextual knowledge retrieval, and graph-based inference within DAZN's global data platform. This role offers an opportunity to work at the intersection of data engineering, AI agents, and knowledge graphs, directly impacting streaming quality, content intelligence, discovery, and fan engagement. Key Responsibilities: - Build and maintain pipelines integrating LLMs, LangChain, LangGraph, and other orchestration frameworks. - Develop autonomous and human-in-the-loop agen...