10863 Airflow Jobs - Page 15

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Job Title: AWS Senior Data Engineer Experience Required: Minimum 3-7 years Job Summary: We are seeking a skilled Data Engineer with a strong background in data ingestion, processing, and storage. The ideal candidate will have experience working with various data sources and technologies, particularly in a cloud environment. You will be responsible for designing and implementing data pipelines, ensuring data quality, and optimizing data storage solutions. Key Respo...

Overview Architect, build, and maintain scalable AI/ML and GenAI solutions for enterprise applications. Actively contribute to AI strategy and roadmap in collaboration with leadership and product teams. Ensure robustness, reliability, and optimization of production-grade data pipelines and ML systems. Drive end-to-end AI/ML lifecycle from ideation to deployment and monitoring. Responsibilities We are looking for a seasoned AI/ML engineer with a deep passion for data and innovation, a proactive mindset, and strong ownership of solutions. You will play a pivotal role in shaping our generative AI initiatives, delivering impactful and scalable intelligence across business verticals within Sustai...

Teamwork makes the stream work. Roku is changing how the world watches TV Roku is the #1 TV streaming platform in the U.S., Canada, and Mexico, and we've set our sights on powering every television in the world. Roku pioneered streaming to the TV. Our mission is to be the TV streaming platform that connects the entire TV ecosystem. We connect consumers to the content they love, enable content publishers to build and monetize large audiences, and provide advertisers unique capabilities to engage consumers. From your first day at Roku, you'll make a valuable - and valued - contribution. We're a fast-growing public company where no one is a bystander. We offer you the opportunity to delight mil...

Greetings from Infobeans!! We are hiring Sr BI Engineer (Data Engineer) Exp: 7+ Yrs NP: Immediate Location: Pune Education : Bachelor's or Master Degree in Computer science only PFB the JD Key Responsibilities Architect and maintain scalable, reliable data pipelines for batch and real-time processing. Write high-quality Python code to manipulate and transform large datasets. Implement data modeling, ETL processes, and orchestration frameworks (e.g., Airflow, Prefect). Ensure data quality, consistency, and documentation across systems and stakeholders. Collaborate closely with data analysts, data scientists, and engineering teams to support business needs. Optimize performance of databases an...

Consultant Engineer for Liquidity Program - India, Gurugram Key points about the role - We seek a mid-level engineer to design and build Liquidity calculations using our bespoke Data Calculation Platform (DCP), based on documented business requirements. The front-end of the DCP is Dataiku, but prior experience with Dataiku is not necessary if they've had experience working as a data engineer. Liquidity experience is not necessary, but it would be helpful if they've had experience designing and building to business requirements. There is a requirement to work 3 days in the office in Gurugram. They will work as part of a team that is located in both Sydney and Gurugram. The reporting manager w...

Job Title : AWS Data Engineer Experience : 9+ years total, 7+ years relevant Location : Chennai Job Description Design, develop, and optimize data pipelines & ETL processes using AWS Glue and EMR. Build and manage data lakes (S3) and data warehouses (Redshift) for analytics/reporting. Work with AWS services: Lambda, SNS, SQS, Glue Crawlers, Glue Catalog, Athena, RDS (PostgreSQL). Integrate diverse data sources into S3 with efficient ingestion and transformation. Implement and manage orchestration tools (e.g., AWS Airflow). Ensure smooth batch and real-time processing. Implement real-time streaming with Amazon Kinesis Data Firehose for low-latency delivery. Design and maintain APIs for integr...

Industry & Sector: IT Services — Cloud & Data Engineering practice focused on building enterprise-scale analytics platforms, cloud data lakes, and production-grade ETL/ELT solutions on AWS for large commercial and enterprise clients. Location: India (On-site). Role: AWS Data Engineer — hands-on contributor building scalable, secure data pipelines and analytics back-ends. AWS Data Engineer Role & Responsibilities Design, build and operate scalable ETL/ELT data pipelines on AWS (S3, Glue, Redshift, Athena) to ingest, transform and serve structured and semi-structured data. Develop and optimise PySpark / Python jobs for performance, cost-efficiency and data quality; troubleshoot failures and im...

Industry & Sector: IT Services — Cloud & Data Engineering practice focused on building enterprise-scale analytics platforms, cloud data lakes, and production-grade ETL/ELT solutions on AWS for large commercial and enterprise clients. Location: India (On-site). Role: AWS Data Engineer — hands-on contributor building scalable, secure data pipelines and analytics back-ends. AWS Data Engineer Role & Responsibilities Design, build and operate scalable ETL/ELT data pipelines on AWS (S3, Glue, Redshift, Athena) to ingest, transform and serve structured and semi-structured data. Develop and optimise PySpark / Python jobs for performance, cost-efficiency and data quality; troubleshoot failures and im...

Who We Are Wayfair’s Advertising business is rapidly expanding, adding hundreds of millions of dollars in profits to Wayfair. We are building Sponsored Products, Display & Video Ad offerings that cater to a variety of Advertiser goals while showing highly relevant and engaging Ads to millions of customers. We are evolving our Ads Platform to empower advertisers across all sophistication levels to grow their business on Wayfair at a strong, positive ROI and are leveraging state of the art Machine Learning techniques. The Advertising Optimization & Automation Science team is central to this effort. We leverage machine learning and generative AI to streamline campaign workflows, delivering impa...

Our technology services client is seeking multiple Azure DevOps Engineer to join their team on a contract basis. These positions offer a strong potential for conversion to full-time employment upon completion of the initial contract period. Below are further details about the role: Role: Azure DevOps Engineer Experience: 8- 12 Years Location: PAN India Notice Period: Immediate- 15 Days Mandatory Skills: Apache Airflow, CI/CD, IaaC Job Description: We are seeking an experienced Azure DevOps Engineer to design, implement, and manage DevOps practices in a cloud-native environment. The ideal candidate will have strong expertise in Azure, CI/CD pipelines, Infrastructure as Code (IaC), Git-based v...

Industry & Sector: IT Services — Cloud & Data Engineering practice focused on building enterprise-scale analytics platforms, cloud data lakes, and production-grade ETL/ELT solutions on AWS for large commercial and enterprise clients. Location: India (On-site). Role: AWS Data Engineer — hands-on contributor building scalable, secure data pipelines and analytics back-ends. AWS Data Engineer Role & Responsibilities Design, build and operate scalable ETL/ELT data pipelines on AWS (S3, Glue, Redshift, Athena) to ingest, transform and serve structured and semi-structured data. Develop and optimise PySpark / Python jobs for performance, cost-efficiency and data quality; troubleshoot failures and im...

Greetings from Infobeans (www.infobeans.com) Job Title: Senior Data Engineer Skills: Python, Data Engineering Experience Required: 7+ Years Location: Pune Notice Period: Immediate Joiners Preferred About the Role We are seeking a Senior Data Engineer with a passion for building scalable data infrastructure, fluent Python skills, and a sharp analytical mindset. You will design, build, and optimize our data pipelines and architectures to support critical data-driven initiatives across the business. Your work will directly impact the quality and accessibility of our analytics, data science, and reporting systems. Key Responsibilities Architect and maintain scalable, reliable data pipelines for ...

Job Title: Big Data Engineer Location: Pune (Hybrid) Experience - 5-7 YOE Salary Range: ₹35–40 LPA About the Role We are looking for a Big Data Engineer to design, build, and scale high-performance data pipelines that power our products and insights. You’ll be working closely with product managers, architects, and engineering leads to define technical strategies and ensure the availability, reliability, and quality of data across the organization. This is a high-impact individual contributor role with ownership of critical data components and the opportunity to shape our evolving data platform. Key Responsibilities Design, build, and maintain robust data pipelines (batch and streaming) from ...

Industry & Sector: IT Services — Cloud & Data Engineering practice focused on building enterprise-scale analytics platforms, cloud data lakes, and production-grade ETL/ELT solutions on AWS for large commercial and enterprise clients. Location: India (On-site). Role: AWS Data Engineer — hands-on contributor building scalable, secure data pipelines and analytics back-ends. AWS Data Engineer Role & Responsibilities Design, build and operate scalable ETL/ELT data pipelines on AWS (S3, Glue, Redshift, Athena) to ingest, transform and serve structured and semi-structured data. Develop and optimise PySpark / Python jobs for performance, cost-efficiency and data quality; troubleshoot failures and im...

Job Title: Assistant General Manager - Administration & Marketing Strategy Company: Syntec Airflow Systems Location: Gurgaon , Haryana About Syntec Airflow Systems: Syntec Airflow Systems is a leading provider of innovative and high-quality airflow solutions. With a strong commitment to engineering excellence and customer satisfaction, we design, manufacture, and distribute a wide range of products for various industrial and commercial applications. We are experiencing significant growth and are seeking a dynamic and results-oriented Assistant General Manager to oversee our administrative functions and drive our marketing strategy. Job Summary: The Assistant General Manager - Administration ...

About the Company Our client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success, they empower clients and society to move confidently into the digital future. Job Summary We are looking for a highly skilled Databricks or equivalent bigdata frameworks, CDC (change Data Capture), Kafka. Job Description: Data Engineer Locations : Chennai Mode: Hybrid Notice Period :Immediate to15 Days Max Experience: 7+ Years Mandatory Skill: 6+ years of experience designing and building data pipelines using Apache Spark, Databrick...

As a Senior Data Analyst / Engineer at Barclays, you will spearhead the evolution of the digital landscape and drive innovation and excellence. You will leverage cutting-edge technology to revolutionize digital offerings, ensuring unparalleled customer experiences. **Key Responsibilities:** - Extensive experience with Data visualization tools such as Tableau and Power BI - Familiarity with Data Platforms like Data Bricks and Snow Flakes - Understanding of Cloud Platforms like AWS and Kafka - Designing and building Data Models, Data Warehouse & Marts - Proficiency in Data integration tools like SSIS - Hands-on experience in writing complex stored procedures, Functions & Triggers using T-SQL -...

Data Engineer 2 Position Summary: As a Data Engineer, you will be part of a highly talented Data Engineering team. Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines. You will be contributing to different stages of data engineering like data acquisition, ingestion, processing, monitoring pipelines and validating data. Your contribution will be really crucial in keeping various data ingestion and processing pipelines running successfully. Along with ensuring the data points available in the data lake are up to date, valid and usable. Technology Experience: 3+ years of experience in data engineering. Comfortable and hands on with t...

Equifax is seeking creative, high-energy and driven software engineers with hands-on development skills to work on a variety of meaningful projects. Our software engineering positions provide you the opportunity to join a team of talented engineers working with leading-edge technology. You are ideal for this position if you are a forward-thinking, committed, and enthusiastic software engineer who is passionate about technology. What You’ll Do Demonstrate a deep understanding of cloud native, distributed micro service based architectures Deliver solutions for complex business problems through software standard SDLC Build strong relationships with both internal and external stakeholders includ...

Role: DevOps Engineer (Cloud Build & Terraform Specialist) Location: Gurgaon Experience Range: 4+ years About the Role We are looking for skilled DevOps Engineers with strong expertise in CI/CD automation using Google Cloud Build and Infrastructure-as-Code (IaC) with Terraform . The selected candidates will be responsible for designing, implementing, and managing automated pipelines and infrastructure provisioning across GCP environments. This role offers opportunities for both mid-level engineers to strengthen their expertise and senior engineers to drive strategy, governance, and best practices. Key Responsibilities CI/CD Automation Build, optimize, and maintain Cloud Build pipelines for a...

As a Software Engineer III at JPMorgan Chase within the Corporate Technology, your role involves serving as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable manner. Your responsibilities include executing software solutions, design, development, and technical troubleshooting with the ability to think innovatively, creating secure and high-quality production code, producing architecture and design artifacts for complex applications, and contributing to software engineering communities of practice and events exploring new technologies. You are also expected to proactively identify hidden problems and patterns ...

As a Senior Full Stack Developer with expertise in Python (FastAPI/Flask) and React.js (Next.js), your role will involve designing, building, and maintaining scalable APIs and web applications. You will work across both backend and frontend stacks, contributing to the overall architecture and development process. If you enjoy working in a fast-paced environment and are dedicated to producing clean, testable, and high-quality code, this opportunity is perfect for you. Key Responsibilities: - Architect, develop, and maintain robust backend services using Python (FastAPI or Flask). - Build highly interactive frontend applications using React.js and Next.js. - Design and implement scalable Graph...

Company:Global Technology organization Key Skills: Data Structures Algo, Database, Python, Microservices, Cloud, CICD, Orchestration, React, Observability, IAC, Messaging, Angular Roles and Responsibilities: Design, build, and optimize backend services using Python, Node.js, Go, or Java. Drive system architecture, refactoring, and design reviews for scalable solutions. Troubleshoot complex issues with strong debugging and root cause analysis (RCA) skills. Lead database development efforts with Postgres, MySQL, and Redis. Implement messaging systems (Kafka, RabbitMQ) for distributed workloads. Leverage cloud platforms (AWS/GCP) to build secure, resilient, and cost-optimized systems. Apply Inf...

About Company : They balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation. We guide customers from what’s now to what’s next by unlocking the value of their data and applications to solve their digital challenges, achieving outcomes that benefit both business and society. About Client: Our client is a global digital solutions and technology consulting company headquartered in Mumbai, India. The company generates annual revenue of over $4.29 billion (₹35,517 crore), reflecting a 4.4% year-over-year growth in USD terms. It has a workforce of around 86,000 professionals operating in more than 40 countries and se...

As a Backend Software Engineer at Wayfair, you will be joining the Fulfillment Optimization team, responsible for building platforms that optimize customer order fulfillment for Wayfair profitability and customer satisfaction. Your role will involve enhancing and scaling customer-facing platforms that provide fulfillment information on the website, from search pages to order delivery. You will play a crucial role in maintaining an accurate representation of the dynamic supply chain, predicting product packaging, warehouse flow, and surfacing necessary information for customers, suppliers, and carriers in milliseconds. **Key Responsibilities:** - Build and launch data pipelines and products f...