15348 Airflow Jobs - Page 28

Overview In this role, you will play a key role in automating and streamlining the data processing pipeline for AMESA markets. Responsibilities Own data pipeline development end-to-end, spanning data modeling, testing, scalability, operability and ongoing metrics. Ensure that we build high quality software by reviewing peer code check-ins Define best practices for product development, engineering, and coding as part of a world class engineering team in Hyderabad Focus on delivering high quality data pipelines and tools through careful analysis of system capabilities and feature requests, peer reviews, test automation, and collaboration with QA engineers Develop software in short iterations t...

Model Development Individual Contributor - Work independently with team lead(s) Hands-on programming and development Data Analysis Problem Solving - work toward getting the optimal solution of a given problem Tuning & Optimization Conduct risk based tuning of AML scenarios and maintain standards for BTL (Below the Line) ATL (Above the Line) alert testing Support ongoing optimization to the effectiveness of all in scope BAU transaction monitoring systems, scenarios and rules Model Testing & UAT Perform UAT and systems integraton testing of AML model for Significant experience and direct knowledge of AML Transaction Monitoring systems and preferably Oracle Mantas, Prime BSA and Actimize is a b...

Job Description We are seeking an experienced Snowflake Database Administrator DBA to join our team The ideal candidate will have a deep understanding of Data Warehousing fundamentals and concepts with a proven track record in Snowflake administration Key Responsibilities Database Management Oversee and manage Snowflake databases including user management security management performance tuning high availability space management and backuprecovery processes Automation Implement and support automation for production deployments in Snowflake Automate database administration tasks using PLSQL shell scripts and other relevant scripting languages Troubleshooting Diagnose and resolve Snowflake data...

Overview Join the Prodapt team in supporting a unified, scalable, and secure Jupyter-based environment for data science and machine learning. You will help build, maintain, and optimize the platform that empowers analysts, engineers, and scientists to explore data, develop models, and collaborate at scale. Responsibilities Develop, maintain, and enhance the Notebook platform built on JupyterLab, supporting both cloud and on-premises deployments. Integrate and optimize connections to diverse data sources (BigQuery, Hive, Teradata, Hadoop, Spark, etc.). Enable and support distributed data processing and analytics using Spark/PySpark and Dataproc. Implement and maintain platform features for co...

Overview Join the Prodapt team in building a unified, cloud-native environment for scalable machine learning training and experimentation. You will help design, develop, and optimize robust workflows that empower data scientists and engineers to efficiently explore, train, and validate ML models at scale. Responsibilities Overall experience of 10+ years with proven track recordof over-achieving engineering, platform delivery and scaling targets in highvolume, innovativeand fast-paced high-pressure environment; proven results in delivery on platform products. Solid proficiency in programming languages such as Python, Go and Java Experience with cloud platforms (e.g., GCP, AWS, Azure) and cont...

What you'll do As a Data Engineer, youll be looking to simplify our organisation by developing innovative data driven solutions through data pipelines, modelling and ETL design, inspiring to be commercially successful while keeping our customers, and the banks data, safe and secure. Youll drive customer value by understanding complex business problems and requirements to correctly apply the most appropriate and reusable tool to gather and build data solutions. Youll support our strategic direction by engaging with the data engineering community to deliver opportunities, along with carrying out complex data engineering tasks to build a scalable data architecture. Your responsibilities will al...

The Company PayPal has been revolutionizing commerce globally for more than 25 years. Creating innovative experiences that make moving money, selling, and shopping simple, personalized, and secure, PayPal empowers consumers and businesses in approximately 200 markets to join and thrive in the global economy. We operate a global, two-sided network at scale that connects hundreds of millions of merchants and consumers. We help merchants and consumers connect, transact, and complete payments, whether they are online or in person. PayPal is more than a connection to third-party payment networks. We provide proprietary payment solutions accepted by merchants that enable the completion of payments...

System Architect Cloud, Data & AI Engineering Platform Summary Accomplished System Architect with over 12 years of experience in designing and delivering large-scale, secure, and intelligent enterprise systems. Specialized in building end-to-end platforms that unify cloud engineering, data processing, and AI-driven intelligence. Deep expertise in Java- and Python-based microservices , event-driven architectures, and product-grade engineering. Recognized for driving system design excellence , enforcing design patterns , and ensuring code quality and maintainability across complex distributed environments. Proven ability to translate strategic business and analytical goals into resilient, high...

About the Role Phonologies is seeking a hands-on ML Engineer who bridges data engineering and machine learning designing and implementing production-ready ML pipelines that are reliable, scalable, and automation-driven. Youll own the end-to-end workflow: from data transformation and pipeline design to model packaging, fine-tuning preparation, and deployment automation. This is not a Data Scientist or MLOps role its data-focused engineering position for someone who understands ML systems deeply, builds robust data workflows, and develops the platforms that power AI in production. Role & responsibilities Machine Learning Pipelines & Automation: Design, deploy and maintain end-to-end ML pipelin...

About the project: Data solution to gather and transform data from multiple heterogeneous systems across our client’s organization into the Azure Data Lakehouse using Databricks and ADF. Responsibilities: Design complex ETL processes of various data sources in the data Lakehouse Build new and maintain existing data pipelines using Python to improve efficiency and latency Improve data quality through anomaly detection by building and working with internal tools to measure data and automatically detect changes Identify, design, and implement internal process improvements, including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes Pe...

AI/ML Engineer Location: Bangalore EXP: 5 to 8Yrs Mandatory skills: Python, Pyspark, SQL, Traditional ML, MLOPS Job Summary: The primary purpose of this role is to design, build and maintain the data pipelines & ML ops systems, conducting experiments & performing statistical analysis, EDA & bringing insights aiding fine-tune models, training & retraining ML models as needed that enable the organization to process large volumes of data & also productionize, scale & manage AI/ML models. The main goal includes support to optimizing model training and inference. This role will harness AI/ML platform capabilities and help accelerate the development of Data & AI/ML driven products. Roles & Respons...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Data Engineer Job Description Develop and maintain scalable data pipelines using tools like Apache Kafka, Apache Spark, or AWS Glue to ingest, process, and transform large datasets from various sources, ensuring efficient data flow and processing. Design and implement data models and schemas in data warehouses (e.g., Amazon Redshift, Google BigQuery) and data lakes (e.g., AWS S3, Azure Data Lake) to support analytics and reporting needs. Collaborate with data scie...

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a PLSQL Developer - Digital Solution Cnslt. Sr. Consultant to join our team in Bangalore, Karntaka (IN-KA), India (IN). 6+ years of experience in SQL, PL/SQL and ETL is mandatory Experience with Relational databases like PostgreSQL. Experience with data visualization tools like Tableau, Power BI, or similar. Experience with the Salesforce.com platform and related technologies Proficiency in data manipulation and analysis using SQL. Good to have Airflow, Tableau Agile Meth...

The Data Engineer exercises judgment when following general instructions and works with minimal instruction to support the integration and automation of data solutions. This role focuses on data massaging, reconciliation, and analysis, resolving routine to semi-routine issues. Responsibilities include creating optimized SQL queries, managing data pipelines, and collaborating with cross-functional teams to ensure data accuracy and availability. What will you do: Write optimized and scalable complex SQL queries Automate data processing tasks using Python, focusing on cleaning and merging datasets. Manage data pipelines, including scheduling, monitoring, and debugging workflows. Collaborate wit...

About the Job The Data And AI team is a highly focused effort to lead digital-first execution and transformation at Red Hat leveraging data & AI strategically for our customers, partners, and associates. The engineering team is focused on building and delivering strategic AI agents & MCP Servers built on our Data & AI platform, designed to augment human capabilities, accelerate business workflows, and scale operations across the enterprise. In this role, you'll take ownership of end-to-end ML systems, champion best practices, and deliver impactful, production-grade models. Youll work autonomously, mentor others, and collaborate with data, engineering, and product teams to bring AI & agentic ...

Relocation Assistance Offered Within Country Job Number #170264 - Mumbai, Maharashtra, India Who We Are Colgate-Palmolive Company is a global consumer products company operating in over 200 countries specialising in Oral Care, Personal Care, Home Care, Skin Care, and Pet Nutrition. Our products are trusted in more households than any other brand in the world, making us a household name! Join Colgate-Palmolive, a caring, innovative growth company reimagining a healthier future for people, their pets, and our planet. Guided by our core values—Caring, Inclusive, and Courageous—we foster a culture that inspires our people to achieve common goals. Together, let's build a brighter, healthier futur...

Who We Are Escalent is an award-winning data analytics and advisory firm that helps clients understand human and market behaviors to navigate disruption. As catalysts of progress for more than 40 years, our strategies guide the world’s leading brands. We accelerate growth by creating a seamless flow between primary, secondary, syndicated, and internal business data, providing consulting and advisory services from insights through implementation. Based on a profound understanding of what drives human beings and markets, we identify actions that build brands, enhance customer experiences, inspire product innovation and boost business productivity. We listen, learn, question, discover, innovate...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Core Responsibilities Of a Data Engineer In D&A Data Pipeline Design & Development Data Engineers are responsible for designing and building robust, scalable, and high-quality data pipelines that support analytics and reporting needs. This includes: ETL/ELT development using tools like Azure Data Factory, Databricks, and Snowflake. Integration of structured and unstructured data from various sources into data lakes and warehouses. Cloud Platform Engineering They o...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Data Engineer Job Description Develop and maintain scalable data pipelines using tools like Apache Kafka, Apache Spark, or AWS Glue to ingest, process, and transform large datasets from various sources, ensuring efficient data flow and processing. Design and implement data models and schemas in data warehouses (e.g., Amazon Redshift, Google BigQuery) and data lakes (e.g., AWS S3, Azure Data Lake) to support analytics and reporting needs. Collaborate with data scie...

Work Location: Chennai (Work From Office) Department Overview The Decision Support Systems (DSS) function enables data-driven decision-making across Matrimony.com by delivering high-quality data pipelines, analytical platforms, and intelligent planning tools. The team partners with business leaders, product teams, and product engineering teams to convert raw data into actionable insights that power strategic, operational, and commercial decisions across the organization. Role Overview: We are seeking a Data Engineering Lead to drive the development and optimization of our enterprise data pipelines, analytical data models, and decision-support infrastructure at Matrimony.com. In this role, yo...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Data Engineer Job Description Develop and maintain scalable data pipelines using tools like Apache Kafka, Apache Spark, or AWS Glue to ingest, process, and transform large datasets from various sources, ensuring efficient data flow and processing. Design and implement data models and schemas in data warehouses (e.g., Amazon Redshift, Google BigQuery) and data lakes (e.g., AWS S3, Azure Data Lake) to support analytics and reporting needs. Collaborate with data scie...

About Amgen Amgen harnesses the best of biology and technology to fight the world’s toughest diseases, and make people’s lives easier, fuller and longer. We discover, develop, manufacture and deliver innovative medicines to help millions of patients. Amgen helped establish the biotechnology industry more than 40 years ago and remains on the cutting-edge of innovation, using technology and human genetic data to push beyond what’s known today. About The Role Role Description: The role is responsible for designing, building, maintaining, analyzing, and interpreting data to provide actionable insights that drive business decisions. This role involves working with large datasets, developing repor...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. Core Responsibilities Of a Data Engineer In D&A Data Pipeline Design & Development Data Engineers are responsible for designing and building robust, scalable, and high-quality data pipelines that support analytics and reporting needs. This includes: ETL/ELT development using tools like Azure Data Factory, Databricks, and Snowflake. Integration of structured and unstructured data from various sources into data lakes and warehouses. Cloud Platform Engineering They o...

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world. EY-Advisory - Data and Analytics – Senior – Data Engineer(Scala) EY's Advisory Services is a unique, industry-focused business unit that provides a broad range of integrated services that leverage deep industry experience with strong functional and technical capabilities and product knowledge. EY’s financial services practice provides integrated advisory services to financial institutions and other capital markets participants, including commercial banks, retail b...

Job Description Change the world. Love your job. We are seeking experienced Data Scientist to join our team. As the Data Scientist in our Demand Analytics team, you will play a pivotal role in shaping and executing our demand planning and inventory buffer strategies for the company. You will be working side by side with a team of highly technical professionals that will consists of application developers, system architects, data scientists and data engineers. This role will be responsible for solving complex business problems through innovative solutions that deliver tangible business value. This position requires a technical leader with a strong technical background in AI/ML , simulation so...