10801 Airflow Jobs - Page 2

Comcast brings together the best in media and technology. We drive innovation to create the world's best entertainment and online experiences. As a Fortune 50 leader, we set the pace in a variety of innovative and fascinating businesses and create career opportunities across a wide range of locations and disciplines. We are at the forefront of change and move at an amazing pace, thanks to our remarkable people, who bring cutting-edge products and services to life for millions of customers every day. If you share in our passion for teamwork, our vision to revolutionize industries and our goal to lead the future in media and technology, we want you to fast-forward your career at Comcast. Job S...

As a member of the Zinnia data team, you will play a crucial role in leveraging data to uncover opportunities, make informed decisions, and drive business strategy. Your responsibilities will include: - Overseeing technological choices and implementing data pipelines and warehousing philosophy - Serving as lead and/or Subject Matter Expert (SME) on projects involving automation of data value chain processes - Promoting technical best practices within the data organization - Designing a maintainable data architecture to enable efficient work with data for Data Analysts, Data Scientists, and stakeholders - Mentoring data team members in architecture and coding techniques - Designing data pipel...

Expedia Group brands power global travel for everyone, everywhere. We design cutting-edge tech to make travel smoother and more memorable, and we create groundbreaking solutions for our partners. Our diverse, vibrant, and welcoming community is essential in driving our success. Why Join Us? To shape the future of travel, people must come first. Guided by our Values and Leadership Agreements, we foster an open culture where everyone belongs, differences are celebrated and know that when one of us wins, we all win. We provide a full benefits package, including exciting travel perks, generous time-off, parental leave, a flexible work model (with some pretty cool offices), and career development...

Role Overview: As a Full Stack Data Engineer, you will collaborate with Data Scientists and Product Development teams to create cutting-edge data products that align with Company Objectives. Your responsibilities will include landing data, developing new data products, enhancing existing solutions, and validating solutions with Analytics & Business partners for production release. Key Responsibilities: - Work with Data Scientists and Product Development teams to develop industry-leading data products - Land data and develop new data products - Enhance existing data products - Collaborate with Analytics & Business partners to validate solutions for production release - Utilize GCP services su...

Role Overview: As a Data Engineering Leader at the company, you will be responsible for driving technical excellence in data management and architecture. Your role involves designing and delivering high-quality data solutions, ensuring compliance with regulatory requirements, and providing technical leadership across the data product development lifecycle. Your expertise will be crucial in improving data management efficiency through AI capabilities and best practices. Key Responsibilities: - Work independently or as a team member to ensure timely delivery of products and goals - Write clean and scalable code to handle large volumes of data - Embed Privacy-by-Design principles into data solu...

Ninja Van is a late-stage logtech startup that is disrupting a massive industry with innovation and cutting edge technology. Launched 2014 in Singapore, we have grown rapidly to become one of Southeast Asia's largest and fastest-growing express logistics companies. Since our inception, we’ve delivered to 100 million different customers across the region with added predictability, flexibility and convenience. Join us in our mission to connect shippers and shoppers across Southeast Asia to a world of new possibilities. More About Us We process 250 million API requests and 3TB of data every day. We deliver more than 2 million parcels every day. 100% network coverage with 2600+ hubs and stations...

Experience on Python, Python ML packages, TensorFlow, PyTorch. -Experience on Python, Flask, TensorFlow, PyTorch, SQL, NOSQL, Vector -Understanding of data structures, data modelling and data pipeline design in PySpark, Apache Airflow preferable A day in the life of an Infoscion As part of the Infosys delivery team, your primary role would be to ensure effective Design, Development, Validation and Support activities, to assure that our clients are satisfied with the high levels of service in the technology domain. You will gather the requirements and specifications to understand the client requirements in a detailed manner and translate the same into system requirements. You will play a key ...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Key Responsibilities: 1. Design and implement data pipelines for seamless data ingestion. 2. Utilize AWS technologies, including S3, Glue, and Lambda, for effective data management. 3. Collaborate with cross-functional teams to enhance data processes using Python, PySpark, and SQL. 4. Implement CI/CD deployments for streamlined development processes. 5. Understand Data Warehouse concepts to ensure efficient data storage and retrieval. 6. Orchestrate data workflows using AWS Step Functions and Apache Airflow. 7. Able to create data pipeline using AWS services and Snowflake with DBT. 8. Able to utilize Snowflake concepts to streamline data processing and reduce bottlenecks of time and variable...

Overview Proficient MLOps engineer capable of independently managing production model deployments, pipelines, and infrastructure operations. Responsibilities: Deploy and maintain ML models in production using technologies like AWS SageMaker, MLflow, or Kubeflow. Manage pipelines and CI/CD workflows using tools like ArgoCD, Terraform, or similar infrastructure-as-code platforms. Support data workflows and ETL orchestration through technologies like Astronomer or Airflow. Collaborate with data science teams to transition models into production environments. Perform root cause analysis and remediation for incidents. Qualifications: 24 years of experience in MLOps or DevOps. Proficiency with one...

Join us as a Software Engineer, PySpark This is an opportunity for a driven Software Engineer to take on an exciting new career challenge Day-to-day, you'll build a wide network of stakeholders of varying levels of seniority Its a chance to hone your existing technical skills and advance your career We're offering this role at associate vice president level What you'll do In your new role, youll engineer and maintain innovative, customer centric, high performance, secure and robust solutions. Youll be working within a feature team and using your extensive experience to engineer software, scripts and tools that are often complex, as well as liaising with other engineers, architects and busine...

Role: Data Engineer Location: Bangalore (Hybrid) (2 or 3 days/week). Job description Core Skills : ETL Orchestration : Apache Airflow (primary). Scripting : Python (mediumcomplex), Unix Shell. Databases : Oracle, Postgres (MongoDB nice to have). SQL/PL-SQL : Queries & transformations. Data Handling : Large volumes, DBMS fundamentals, entity relationships. Additional : Exposure to DART (Data Analysis & Reconciliation Tool) . Full Stack Knowledge : Basic exposure (UI/API + backend). Looking for IMMEDIATE JOINERS OR max 30 Days notice. If you are interested, kindly share your UPDATED resume with reehana.sk@rrootshell.com LinkedIn ID : linkedin.com/in/reehana-sheik-8b9540209 Company Background: ...

We are hiring a Senior Data Engineer to join our team. At Kroll, we are building a strong, forward-looking data practice that integrates artificial intelligence, machine learning, and advanced analytics. You will be designing, building, and integrating data pipelines from diverse sources and collaborate with teams that serve the world’s largest financial institutions, law enforcement bodies, and government agencies. This role will partner with and have a dotted-line relationship with the Alternative Asset Advisory service line, supporting their strategic data initiatives and client delivery goals. The Day-to-day Responsibilities Include But Not Limited To Design and build robust, scalable or...

About Amgen Amgen harnesses the best of biology and technology to fight the world’s toughest diseases, and make people’s lives easier, fuller and longer. We discover, develop, manufacture and deliver innovative medicines to help millions of patients. Amgen helped establish the biotechnology industry more than 40 years ago and remains on the cutting-edge of innovation, using technology and human genetic data to push beyond what’s known today. About The Role Role Description: Amgen is seeking a Data Engineer to contribute to designing, building, maintaining, analyzing, and interpreting data to provide actionable insights that drive business decisions. This role involves working with large data...

Position Overview Job Title: Engineer, Associate Location: Pune, India Role Description An Engineer is responsible for designing, developing and support a strategic US Finance Regulatory Reporting platform for the Bank. Join us and you will be on the front lines of transformation for this domain - leveraging cutting edge open-source technologies and highly collaborative agile processes to deliver valuable business solutions that you can be proud of. You will share your passion for technical excellence and engage the full depth of your engineering skills in a diverse cross functional team that partners with business and technology experts globally to develop innovative solutions to complex bu...

Join us as a Software Engineer, PySpark and AWS This is an opportunity for a driven Software Engineer to take on an exciting new career challenge Day-to-day, you'll build a wide network of stakeholders of varying levels of seniority Its a chance to hone your existing technical skills and advance your career We're offering this role at associate vice president level What you'll do In your new role, youll engineer and maintain innovative, customer centric, high performance, secure and robust solutions. Youll be working within a feature team and using your extensive experience to engineer software, scripts and tools that are often complex, as well as liaising with other engineers, architects an...

Profile requirement: AWS, Snowflake, Kafka, Airflow, GitHub, PySpark Key Responsibilities: Design, develop, and maintain scalable ETL/ELT pipelines Ingest data from various sources (APIs, databases, files, etc.) Implement both real-time and batch processing solutions based on use case requirements Ensure data quality through validation and cleansing processes Collaborate with Product Managers and Business Stakeholders to gather and understand data requirements Translate business needs into technical specifications Ensure data security, access control, and compliance with relevant policies Maintain documentation and follow best practices for data engineering Apply only if you have Snowflake a...

Hello, We are hiring for "Data Engineer+Java" for Pune location. Exp:4+Years Loc: Pune Notice Period: Immediate joiners(notice period served or serving candidate) Mandatory Skills : Data Engineer(ETL) Data Build Tool Apache Airflow Java SQL Python PySpark NOTE: We are looking for Immediate joiners(notice period served or serving candidate) Apply only If you are Immediate joiners(notice period served or serving candidate) Apply only if you are having 4+Years of relevant experience into the above mentioned mandatory skills. Job Summary: We are seeking a highly skilled Data Engineer with strong expertise in DBT, Java, Apache Airflow, and DAG (Directed Acyclic Graph) design to join our data plat...

Talent Worx is a growing services & recruitment consulting firm, we are hiring for our client which is a globally leading provider of financial intelligence, data analytics, and AIdriven solutions, empowering businesses worldwide with insights for confident decision making. Join to work on cutting edge technologies, drive digital transformation, and shape the future of global markets. Requirements Experience Range- 3 to 12 years Location- Gurgaon / Hyderabad/Bangalore Role- Data Scientist / Lead Data Scientist / Associate Director, Data Science Key Responsibilities: Define the AI roadmap, choose tooling, and establish best practices for model building, prompt engineering, and fine-tuning. Ar...

Talworx is an emerging recruitment consulting and services firm , we are hiring for our Fintech Product based client, In this role, you will be working with a team or teams of enthusiastic members supporting our critical technology systems and guiding our business partners & end users with industry best practices, solution design, and creating long term value to our customers. engaging work environment. You will work in a (truly) global team and encouraged for thoughtful risk-taking and self-initiative. Requirements Job Summary: As a member of the Cognitive Engineering team, you will build and maintain enterprise-scale data extraction, automation, and ML model deployment pipelines. You will ...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

The healthcare industry is the next great frontier of opportunity for software development, and Health Catalyst is one of the most dynamic and influential companies in this space. We are working on solving national-level healthcare problems, and this is your chance to improve the lives of millions of people, including your family and friends. Health Catalyst is a fast-growing company that values smart, hardworking, and humble individuals. Each product team is a small, mission-critical team focused on developing innovative tools to support Catalyst’s mission to improve healthcare performance, cost, and quality. Health Catalyst is expanding and maintains a large suite of Improvement Apps that ...

ng, transformation, and performance tuning. Experience with Apache Airflow for orchestration of data workflows. Familiarity with CI/CD pipelines and version control (e.g., Git). Strong problem-solving skills and ability to work in a fast-paced environment. Preferred Qualifications: GCP Professional Data Engineer certification. Experience with data modeling and data warehousing concepts. Exposure to other cloud platforms (AWS Job Summary: We are seeking a highly skilled and experienced GCP Data Engineer to join our dynamic data engineering team. The ideal candidate will have a strong background in Google Cloud Platform (GCP) , Airflow , Python , and SQL , with a proven track record of buildin...

Talworx is an emerging recruitment consulting and services firm , we are hiring for our Fintech Product based client, In this role, you will be working with a team or teams of enthusiastic members supporting our critical technology systems and guiding our business partners & end users with industry best practices, solution design, and creating long term value to our customers. engaging work environment. You will work in a (truly) global team and encouraged for thoughtful risk-taking and self-initiative. Requirements Job Summary: As a member of the Cognitive Engineering team, you will build and maintain enterprise-scale data extraction, automation, and ML model deployment pipelines. You will ...

At R Systems , You will contribute to the design and development of data systems including pipelines, APIs, analytics, AI and machine learning at scale. You'll be a core part of our Data team. This role emphasizes hands-on development, reliability, and team collaboration. Experience & Technical Requirements: 3–5 years of development experience, with production systems in cloud environments. Proficient in Python and/or Golang, and SQL for data processing, transformation, and orchestration tasks. Experience with at least one modern cloud platform (e.g., GCP, AWS, or Azure). Experience building and maintaining ETL/ELT pipelines or API-driven data services. Experience with source control (e.g., ...