10863 Airflow Jobs - Page 29

Why We Work at Dun & Bradstreet Dun & Bradstreet unlocks the power of data through analytics, creating a better tomorrow. Each day, we are finding new ways to strengthen our award-winning culture and accelerate creativity, innovation and growth. Our 6,000+ global team members are passionate about what we do. We are dedicated to helping clients turn uncertainty into confidence, risk into opportunity and potential into prosperity. Bold and diverse thinkers are always welcome. Come join us! Learn more at dnb.com/careers . About Us Our global community of colleagues bring a diverse range of experiences and perspectives to our work. You'll find us working from a corporate office or plugging in fr...

The Data Engineer exercises judgment when following general instructions and works with minimal instruction to support the integration and automation of data solutions. This role focuses on data massaging, reconciliation, and analysis, resolving routine to semi-routine issues. Responsibilities include creating optimized SQL queries, managing data pipelines, and collaborating with cross-functional teams to ensure data accuracy and availability. What will you do Write optimized and scalable complex SQL queries Automate data processing tasks using Python, focusing on cleaning and merging datasets. Manage data pipelines, including scheduling, monitoring, and debugging workflows. Collaborate with...

9 - 12 Years 1 Opening Trivandrum Role description Role Proficiency: Leverage expertise in a technology area (e.g. Infromatica Transformation Terradata data warehouse Hadoop Analytics) Responsible for Architecture for a small/mid-size projects. Outcomes: Implement either data extract and transformation a data warehouse (ETL Data Extracts Data Load Logic Mapping Work Flows stored procedures data warehouse) data analysis solution data reporting solutions or cloud data tools in any one of the cloud providers(AWS/AZURE/GCP) Understand business workflows and related data flows. Develop design for data acquisitions and data transformation or data modelling; applying business intelligence on data o...

Role Overview: As a Data Analyst in the Compliance Analytics team, you will play a key role in safeguarding financial integrity by leveraging data to detect and prevent financial crimes. Your responsibilities include: Analyzing transaction data to uncover patterns of money laundering and fraud Supporting sanctions screening with advanced data insights Developing and maintaining SQL and Python scripts for data operations Creating interactive dashboards and reports using BI tools like Power BI or Tableau Implementing basic predictive models for fraud scoring and anomaly detection Handling BAU data requests and generating QA samples for monitoring and screening Contributing to AI-driven initiat...

Role Overview We are seeking an experienced Technical Lead – AI to drive the design, development, and deployment of AI-driven solutions across multiple product lines. The ideal candidate will have a proven track record of supporting AI-embedded products , leading Gen AI initiatives (including RAG-based solutions) , and establishing best practices in data pipelines, ML model lifecycle, LLMs, and MLOps . As a Technical Lead, you will collaborate with cross-functional teams to architect scalable AI systems, mentor engineers, and ensure the successful integration of AI capabilities into business applications. Key Responsibilities AI Solution Design & Delivery Lead the end-to-end design and imple...

Role Overview We are seeking a highly skilled AI Developer with 5–8 years of experience in building and supporting AI-driven solutions. The ideal candidate should have worked on multiple AI-embedded products , contributed to Generative AI (GenAI) projects leveraging Retrieval-Augmented Generation (RAG) , and established scalable MLOps practices . You will play a key role in designing, developing, and deploying AI/ML models, ensuring seamless integration into production environments, and driving innovation in next-gen AI applications. Key Responsibilities AI/GenAI Development: Design and develop AI/ML models, with hands-on expertise in LLMs (Large Language Models) and GenAI solutions . Implem...

Overview: Apply Data Warehouse and Cloud techniques to build data pipelines to provide data from different sources for our business, customer and Data Science team. This role offers many exciting challenges and opportunities: Emphasis is on managing end-to-end delivery of Data Contribute to how analytical approach is structured for specification of analysis Contribute insights from conclusions of analysis that integrate with initial hypothesis and business objective. Independently address complex problems Participate in design of analysis and modelling approach with managers and modelers This is a role that requires exceptional programming skills, proven technical leadership, ability to coll...

Company Description: SprintPark is a comprehensive IT consulting and solutions provider located in Hyderabad. We focus on delivering tailored, efficient, and innovative solutions to meet the evolving needs of businesses. Our services include IT consulting, staffing, project management, and software solutions aimed at driving business success and fostering long-term partnerships. Job Description: AI Specialist / Machine Learning Engineer Location: On-site (Hyderabad) Department: Data Science & AI Innovation Experience Level: Mid–Senior Reports To: Director of AI / CTO Employment Type: Full-time Job Summary We are seeking a skilled and forward-thinking AI Specialist to join our advanced techno...

dunnhumby is the global leader in Customer Data Science, empowering businesses everywhere to compete and thrive in the modern data-driven economy. We always put the Customer First. Our mission: to enable businesses to grow and reimagine themselves by becoming advocates and champions for their Customers. With deep heritage and expertise in retail – one of the world's most competitive markets, with a deluge of multi-dimensional data – dunnhumby today enables businesses all over the world, across industries, to be Customer First. dunnhumby employs nearly 2,500 experts in offices throughout Europe, Asia, Africa, and the Americas working for transformative, iconic brands such as Tesco, Coca-Cola,...

Candidate must have good hands-on experience in Cloud Data Engineering. Have contributed for all the Cloud development, migrations, and support works. Must be comfortable on independently maintain and supports EDW, cloud modernization, SQL development, Azure cloud development, ETL using Azure Data Factory. Have successfully implemented data Streaming using Apache Kafka, Kubernetes, Databricks, Snowflake, SQL Server, Airflow for monitoring and support. GIT and DevOps for pipeline automations. Should Lead a team of data engineers. Partner and manage stakeholder relationships Bachelor's degree in computer science, Engineering, or related field. 7+ years of experience in software development. Ex...

Job Title - Retail Specialized Data Scientist – Level 9 – SnC GN Data & AI Management Level: 09 - Consultant Location: Bangalore / Gurgaon / Mumbai / Chennai / Pune / Hyderabad / Kolkata Must have skills: A solid understanding of retail industry dynamics, including key performance indicators (KPIs) such as sales trends, customer segmentation, inventory turnover, and promotions. Strong ability to communicate complex data insights to non-technical stakeholders, including senior management, marketing, and operational teams. Meticulous in ensuring data quality, accuracy, and consistency when handling large, complex datasets. Gather and clean data from various retail sources, such as sales transa...

Job Purpose We are looking for a detail-oriented and analytical Data Engineer to support data-driven decision-making across the organization. The role involves working with large datasets from DealCloud and other sources, identifying trends and patterns, and collaborating with visualization and AI teams. A key focus will be supporting Snowflake integration and building scalable data pipelines. Desired Skills and experience Candidates should have a B.E./B.Tech/MCA/MBA in Information Systems, Computer Science or a related field 6-8 years of professional experience in data engineering or related roles. Strong proficiency in SQL for data manipulation, optimization, and query performance tuning. ...

Job Title: Senior ETL Developer – Complex Data Flows & High-Performance Systems Location: Gurugram Experience: 3+ years Department: Data Engineering / Analytics Job Summary: We are looking for a highly skilled ETL Developer with extensive experience in managing complex data flows , designing scalable pipelines, and optimizing performance in large data environments. The ideal candidate should have hands-on experience with ETL tools , strong knowledge of PostgreSQL , and the capability to manage environments with thousands of processors (e.g., 5000+ in a single PG setup) . Key Responsibilities: Design, build, and maintain robust ETL pipelines for large-scale and complex datasets Develop, optim...

Job Description – Senior Analyst (Data Engineering & Analytics) Position: Senior Analyst Location: Mohali Department: Data Engineering & Analytics Experience Required: 4–7 years Role Overview We are seeking a highly skilled Senior Analyst with strong expertise in data engineering and analytics to join our team. The ideal candidate will have solid experience working with SQL, BigQuery, Python, Pandas, Airflow, and cloud technologies on Google Cloud Platform (GCP). You will play a key role in designing, building, and optimizing data pipelines, ensuring data quality, and supporting analytics initiatives across the organization. Key Responsibilities · Develop, optimize, and maintain scalable ETL...

Job Description: DevOps Engineer Company Overview We are a dynamic and innovative tech company focused on delivering high-quality solutions to our clients. Our team is dedicated to leveraging the latest technologies and best practices in the industry to ensure our products and services meet the highest standards of performance, reliability, and security. Position: DevOps Engineer Location: Mohali Employment Type: Full-Time Job Summary We are seeking a skilled DevOps Engineer with extensive experience in AWS, Terraform, Kubernetes, and related technologies. The ideal candidate will be responsible for managing our cloud infrastructure, automating deployment processes, and ensuring the reliabil...

Role Description Role Proficiency: Leverage expertise in a technology area (e.g. Infromatica Transformation Terradata data warehouse Hadoop Analytics) Responsible for Architecture for a small/mid-size projects. Outcomes Implement either data extract and transformation a data warehouse (ETL Data Extracts Data Load Logic Mapping Work Flows stored procedures data warehouse) data analysis solution data reporting solutions or cloud data tools in any one of the cloud providers(AWS/AZURE/GCP) Understand business workflows and related data flows. Develop design for data acquisitions and data transformation or data modelling; applying business intelligence on data or design data fetching and dashboar...

Freshers - Please Don't Apply Application acceptable till 2022 Graduation Batch only. Job Description – Data Scientist (AI/ML & Data Engineering Focus) Position Overview: We are seeking a Data Scientist with strong expertise in AI/ML and Data Engineering to design data pipelines, build machine learning models, and deploy scalable AI-driven solutions. The role requires a balance of statistical analysis, machine learning expertise, and data engineering skills to transform raw data into actionable insights and intelligent systems. Key Responsibilities: Collect, clean, and transform large structured and unstructured datasets for analysis and model training. Develop, train, and evaluate machine l...

About the Role At PubMatic, data operates at unmatched scale. As a Senior Machine Learning Platform Engineer , you will design and scale the infrastructure and frameworks that enable machine learning development, experimentation, and production across a global ecosystem handling trillions of ad impressions. You will collaborate closely with ML Engineers, Data Scientists, and Product stakeholders to accelerate experimentation, maximize efficiency, and translate AI solutions from concept to production. This role offers direct exposure to petabyte-scale datasets , industry-standard ML efficiency tools (e.g., Triton inference, GPU/accelerated computing), and the opportunity to evaluate and adopt...

MLOps We are looking for a highly skilled Analytics & Data Engineering professional with a strong background in Machine Learning, MLOps, and DevOps . The ideal candidate will have experience designing and implementing scalable data and analytics pipelines, enabling production-grade ML systems, and supporting agent-based development leveraging MCP/OpenAPI to MCP wrapper and A2A protocols . This role combines hands-on technical work with solution design, and will require close collaboration with data scientists, product teams, and engineering stakeholders. Key Responsibilities Design, build, and maintain scalable data pipelines and ETL/ELT processes for analytics and ML workloads. Implement ML...

Role & responsibilities Develop, construct, test and maintain data acquisition pipelines for large volumes of structed and unstructured data. This includes batch and real-time processing (in google cloud). Build large and complex datasets based on business requirements. Construct big data’ pipeline architecture. Identify opportunities for data acquisition via working with stakeholders and business clients. Translate business needs to technical requirements. Leverage a variety of tools in the Google Cloud Ecosystem such as Python, Data Flow, DataStream, CDC (Change Data Capture), Cloud Functions, Cloud Run, Pub Sub, BigQuery, Cloud Storage to integrate systems and data pipelines. Use logs & a...

Data Technology group in MSCI is responsible to build and maintain state-of-the-art data management platform that delivers Reference. Market & other critical datapoints to various products of the firm. The platform, hosted on firms’ data centers and Azure & GCP public cloud, processes 100 TB+ data and is expected to run 24*7. With increased focus on automation around systems development and operations, Data Science based quality control and cloud migration, several tech stack modernization initiatives are currently in progress. To accomplish these initiatives, we are seeking a highly motivated and innovative individual to join the automation team for the purpose of supporting our next genera...

ISS STOXX is looking for a Cloud Security Engineer to join our team in Mumbai (Goregaon East), India. Overview: We are looking for a talent to bring technical expertise to the development and deployment of our cutting-edge financial intelligence platform. In this role, you will leverage your technical expertise and innovative mindset to lead the design, implementation, operation and optimization of our platform infrastructure, ensuring its ability to deliver efficient and reliable data services to our global client base. As a senior member of technical team, you will collaborate with cross-functional peers and stakeholders to drive continuous improvement initiatives and ensure our platform r...

Area(s) of responsibility Job Description We are seeking a highly skilled and motivated Data Engineer to join our data team. As a Data Engineer, you will be primarily responsible for designing & developing data transformations and data models to ensure reliable and efficient data processing and analysis. You will work closely with cross-functional teams to support data-driven decision-making processes and contribute to the overall success of our insight’s teams. Key Proficiency & Responsibilities Expertise in DBT (Data Build Tool) for data transformation and modelling. Proficiency in Snowflake, including experience with Snowflake SQL and data warehousing concepts. Strong understanding of dat...

Area(s) of responsibility Job Description We are seeking a highly skilled and motivated Data Engineer to join our data team. As a Data Engineer, you will be primarily responsible for designing & developing data transformations and data models to ensure reliable and efficient data processing and analysis. You will work closely with cross-functional teams to support data-driven decision-making processes and contribute to the overall success of our insight’s teams. Key Proficiency & Responsibilities Expertise in DBT (Data Build Tool) for data transformation and modelling. Proficiency in Snowflake, including experience with Snowflake SQL and data warehousing concepts. Strong understanding of dat...

What you'll do In your new role, youll engineer and maintain innovative, customer centric, high performance, secure and robust solutions. Youll be working within a feature team and using your extensive experience to engineer software, scripts and tools that are often complex, as well as liaising with other engineers, architects and business analysts across the platform. Youll also be: Producing complex and critical software rapidly and of high quality which adds value to the business Working in permanent teams who are responsible for the full life cycle, from initial development, through enhancement and maintenance to replacement or decommissioning Collaborating to optimise our software engi...