15348 Airflow Jobs - Page 16

At Coface we make trade happen everyday Our 5,200 experts representing 80+ nationalities in 58 countries are united by a shared purpose: helping companies navigate through uncertainty by empowering them to make the right decisions and trade smarter in a complex world. With nearly 80 years of global experience, we offer companies a full range of solutions: Trade Credit Insurance, Business Information, Debt Collection, Single Risk insurance, Surety Bonds, Factoring — all driven by a unique data patrimony, cutting-edge technology, innovation and a deep understanding of the global economy. Joining Coface means being part of a close-knit international organization, where your ideas matter. We fos...

About the job Job description Hiring: AWS Data Engineer | Remote | Full-Time Company: Natlov Technologies Pvt. Ltd. Experience: 1–2 years About the Role We’re looking for a skilled AWS Data Engineer to design, build, and manage scalable data solutions on Amazon Web Services (AWS). You’ll work with Apache Airflow, AWS Glue, Big Query and Amazon Redshift to develop automated, high-performance data pipelines. Tech Stack Cloud: Amazon Web Services (AWS) Pipelines: Apache Airflow, AWS Glue Database: MySQL,Big Query Programming: Python Data Warehouse: Amazon Redshift Responsibilities Build and manage data pipelines using Airflow and AWS Glue Develop and optimize data models in Amazon Redshift Auto...

We are inviting experienced GCP Data Engineers to participate in our exclusive F2F Hackathon scheduled on 22nd Nov 2025. If you are passionate about building scalable data solutions on Google Cloud and enjoy solving real-time data engineering challenges, this is the perfect opportunity for you!!! 📢 GCP Data Engineer – Face-to-Face Hackathon 📅 Date: 22nd November 2025 📍 Locations: Bangalore, Hyderabad, Karnataka 🧑 💼 Experience: 5–12 Years 🔧 Required Skills Google Cloud Platform (GCP) – Strong hands-on experience BigQuery – Must to have Python – Must to have SQL – Must to have Dataproc – Spark/Hadoop ecosystem on GCP Airflow – Workflow orchestration 📨 Interested? Apply Now! Kindly share your u...

Responsibilities: Perform exploratory data analysis and various data analysis Build robust data pipeline jobs Design, implement and monitor Machine Learning models Conduct A/B testing Collaborate with cross-functional teams Required Qualifications : Proficiency in Python. Bachelors's degree in Mathematics, Statistics, or a related field. Strong proficiency in data analytics and statistical analysis Excellent problem-solving skills and ability to deliver actionable insights. Strong communication skills and ability to collaborate effectively with cross-functional teams. Preferred Qualifications: Proficiency in PySpark and SQL Master's degree in Mathematics, Statistics, or a related field. Expe...

Job Title: Data Engineer Job Type: Full-time (8hours/day) Location: Hybrid - Delhi, Pune Job Summary Join our customer's team as a Data Engineer, where you’ll leverage cutting-edge data platforms and tools to design, build, and optimize scalable data solutions. This hybrid role is perfect for a passionate data engineer who excels in DBT/Snowflake environments and thrives on both collaboration and independence. Make a significant impact in a fast-paced, contract-based engagement. Key Responsibilities Design, implement, and optimize robust ETL pipelines using DBT in Snowflake databases. Collaborate closely with cross-functional stakeholders to understand data requirements and deliver actionabl...

Job Title: Data Engineer Job Type: Full-time (8hours/day) Location: Hybrid - Delhi, Pune Job Summary Join our customer's team as a Data Engineer, where you’ll leverage cutting-edge data platforms and tools to design, build, and optimize scalable data solutions. This hybrid role is perfect for a passionate data engineer who excels in DBT/Snowflake environments and thrives on both collaboration and independence. Make a significant impact in a fast-paced, contract-based engagement. Key Responsibilities Design, implement, and optimize robust ETL pipelines using DBT in Snowflake databases. Collaborate closely with cross-functional stakeholders to understand data requirements and deliver actionabl...

Grid Dynamics wants to build a centralized, observable and secure platform for their ML, Computer Vision, LLM and SLM models. Grid Dynamics wants to onboard a vast number of AI agents, able to cover multiple required skills, ensuring a certain level of control and security in regards to their usage and availability. The observable platform must be vendor-agnostic, easy to extend to multiple type of AI applications and flexible in terms of technologies, frameworks and data types. This project is focused on establishing a centralized LLMOps capability where every ML, CV, AI-enabled application is monitored, observed, secured and provides logs of every activity. The solution consists of key bui...

Company Description Aptus Data Labs is a leading Data and AI company specializing in Pharma, Manufacturing & Supply Chain, Banking & FinTech, and Technology domains. We offer innovative analytical solutions and consulting services to help businesses make quick, data-driven decisions essential for growth and sustainability in evolving industries. Leveraging cutting-edge technologies, Data Science, and Decision Science, along with our proprietary "Aptus Accelerators," we enable organizations to identify risks and capitalize on key business opportunities. Our team of experts brings deep domain knowledge and technical expertise to extract valuable insights from complex datasets and drive impactf...

Job Summary We are seeking a Data Science Engineer with 3–5 years of experience in designing, developing, and deploying AI/ML solutions. The ideal candidate will have strong programming skills, hands-on experience in model development and training, and the ability to build scalable data and ML pipelines for production environments. You’ll work closely with data scientists, software engineers, and product teams to develop machine learning models, train and fine-tune AI systems, and integrate them into real-world applications. Key Responsibilities Design, develop, and deploy AI/ML models for real-world use cases (e.g., predictive analytics, NLP, computer vision, recommendation systems). Perfor...

Job Summary We are seeking a Data Science Engineer with 3–5 years of experience in designing, developing, and deploying AI/ML solutions. The ideal candidate will have strong programming skills, hands-on experience in model development and training, and the ability to build scalable data and ML pipelines for production environments. You’ll work closely with data scientists, software engineers, and product teams to develop machine learning models, train and fine-tune AI systems, and integrate them into real-world applications. Key Responsibilities Design, develop, and deploy AI/ML models for real-world use cases (e.g., predictive analytics, NLP, computer vision, recommendation systems). Perfor...

Description We are working on a state-of-the-art data engineering and analytics platform for business and operation intelligence. We intend this data to be easily accessed by our users so they can make data driven decisions. We want to provide classical ways to build visualization and provide agentic solutions towards analytics. This will be the application that all our employees will interact daily. A software engineer will design, develop critical back-end components for the application and help information rendering with intuitive UI. We have projects to add complex user interactions that involve large data processing and visualizations through agentic workflows. Responsibilities Help bui...

Greetings from Tata Consultancy Services!!! Required Experience: 5+ Years Location: Bangalore Skills: AWS cloud account management/security, Airflow, Databricks, EKS, Terraform, CI/CD, Spark, Flink, Datadog Required Skills: 6+ years of experience in infrastructure, DevOps, or platform engineering roles supporting production systems. Proven expertise with AWS infrastructure and managed services (EKS, IAM, VPC, ALB/NLB, RDS, etc.) and hands-on Kubernetes operations ( EKS , Istio) at scale. Proficiency in infrastructure-as-code and automation (Terraform, Python, Go, or similar), and in CI/CD toolchains (Jenkins, GitHub, Spinnaker). Experience with observability tooling ( Datadog , Prometheus, o...

About Client: Our Client is a AI first Innovation Engineering Services & Solutions company headquartered in Pittsburgh, our core purpose is to impact lives by transforming businesses through innovation. With a presence in 23 global locations, it boasts an engineering headcount of more than 5,500+ employees. The company engages with its clients through collaborative, white-box engagement models that include extended teams and turn-key projects. It excels in building new products and re-engineering legacy products using state-of-the-art technologies and innovation. Led by an entrepreneurial leadership team that prioritizes execution, outcomes, and continuous learning, It has been recognized as...

Lead BI Developer Job Profile We are seeking a skilled and experienced Business Intelligence (BI) Developer to join our team. The ideal candidate will have strong expertise in SQL, Python, data visualization, and ETL processes. This role involves designing, developing, and maintaining robust data solutions to support business intelligence and data analytics needs. Qualifications Bachelor’s or Master’s degree in computer science, Information Systems, Data Science, or a related field. Experience Minimum of 8-10 years of experience in a similar role, with a strong focus on SQL, Python, data visualization, and ETL. Responsibilities 1. Database Management and SQL Development: a. Design, develop, ...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Position: Senior Data Engineer – Experience: 6–9 Years Role Summary We are seeking Senior Data Engineer resources to work on the migration of applications from our legacy Cloudera environment to the new Kubernetes-based data platform. The role requires strong hands-on development skills in data engineering, with the ability to deliver high-quality pipelines under guidance from internal leads. Core Technical Skills (Must-Have) 1. Apache Spark (PySpark / Scala) 2. SQL (Spark SQL / Trino / HiveQL) 3. Apache Iceberg 4. Apache Airflow (Orchestration) 5. DBT (Data Build Tool) 6. Kubernetes (SKE / AKS) 7. ADO / CI-CD 8. Linux & Shell Scripting Nice-to-Have (Secondary) Skills 1. Python 2.Grafana / P...

Position: Senior Data Engineer – Vendor Experience: 6–12 Years Role Summary We are seeking Senior Data Engineer resources to work on the migration of applications from our legacy Cloudera environment to the new Kubernetes-based data platform. The role requires strong hands-on development skills in data engineering, with the ability to deliver high-quality pipelines under guidance from internal leads. Key Responsibilities Develop and optimize data pipelines using Spark 3.5 and Python/Scala. Migrate existing Hive, Spark, and Control-M jobs to Airflow and DBT-based workflows. Integrate data pipelines with messaging systems (Kafka, Solace) and object stores (S3, MinIO). Troubleshoot and optimize...

Duties & Responsibilities Design, develop, and maintain scalable ETL/ELT data pipelines to support business and analytics needs Write, tune, and optimize complex SQL queries for data transformation, aggregation, and analysis Translate business requirements into well-designed, documented, and reusable data solutions Partner with analysts, data scientists, and stakeholders to deliver accurate, timely, and trusted datasets Automate data workflows using orchestration/scheduling tools (Airflow, ADF, Luigi, etc.) Develop unit tests, integration tests, and validation checks to ensure data accuracy and pipeline reliability Document pipelines, workflows, and design decisions for knowledge sharing and...

This role is for one of the Weekday's clients Min Experience: 6 years Location: Gurugram JobType: full-time We are looking for an experienced Machine Learning Engineer with 6-12 years of hands-on expertise in designing, developing, and deploying AI/ML solutions at scale. The ideal candidate is strong in end-to-end model development, has a deep understanding of applied machine learning, and can translate complex business problems into production-ready ML systems. This role requires a blend of technical excellence, problem-solving capability, data engineering awareness, and a strong understanding of modern AI/ML workflows. Requirements Key Responsibilities Qualifications & Experience End-to-En...

Hello connections! We have urgent openings for AWS Data Engineer. Job Description: We are seeking an experienced Data Engineer to join our team and contribute to the building, development, and support of ETL/ELT pipelines in a cloud-based environment. The ideal candidate will have a strong background in designing, deploying, and maintaining data pipelines using industry-leading tools such as AWS Glue, Airflow, Databricks , or Informatica . Required Skills & Experience: 6–10 years of hands-on experience building ETL/ELT pipelines in cloud environments. Strong proficiency in SQL and Python for data engineering tasks. Hands-on experience with AWS Glue , Airflow , Databricks , or Informatica for...

TCS is Hiring Snowflake DBT Developer For Bangalore, Pune, Hyderabad, Bhubaneswar, Chennai, Kochi location Experience : 6 - 8 years Mode of interview : Virtual Location : Bangalore, Pune, Hyderabad, Bhubaneswar, Chennai, Kochi JOB DESCRIPTION: Must have: Technical Skills Proficiency in Snowflake scripting - stored procedures (SQL), user defined functions, Common Table expressions, Window functions. Experience in creation of Snowpark python procedures and user defined functions. Knowledge of Snowpark architecture, creation of Snowpark data frames, data transformations in Snowpark. Process Parquet, JSON semi structured data in Snowflake using parse_json, lateral flatten DBT (Data build tool) D...

Role Title: Head- Business Intelligence & AI Reporting To: Chief Information Officer Location of Posting: Corporate office, Vadodara Position Overview: We are seeking seasoned Head- Business Intelligence & AI to lead our data strategy, design scalable data models, and drive analytical and AI innovation across the organization. This role combines leadership in data science, AI and business analytics with deep technical expertise in data architecture and modelling, AI/ML, ETL, Dashboards and AI including Gen AI, Agentic AI. The ideal candidate will be a strategic thinker, technical expert, and effective communicator capable of aligning data initiatives with business objectives. As the Head of ...

About the Company Our client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success, they empower clients and society to move confidently into the digital future. Position: Data Engineer Experience: 6+ Years Location: Hyderabad Employment Type: Full-time About the Role We are looking for a highly skilled Data Engineer with 6+ years of experience in designing and building scalable data pipelines, big data processing solutions, and cloud-based data platforms. The ideal candidate will have strong expertise in Big Data ...