15348 Airflow Jobs - Page 40

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Google BigQuery Good to have skills : Data Warehouse ETL Testing Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :Seeking a forward-thinking professional with an AI-first mindset to design, develop, and deploy enterprise-grade solutions using Generative and Agentic AI frameworks that drive innovation, efficiency, and business transformation.As an Application Developer, you will design, build, and configure applications to meet business pro...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals. In data analysis at PwC, you will focus on utilising advanced analytical techniques to extract insights from large datasets and drive data-driven decision-making. You will leverage skills in data manipulation, visualisation, and statistical modelling to support clients in solving complex business problems. Wh...

Job Description We are seeking a skilled Data Engineer with over 5+ years of experience to design, build, and maintain scalable data pipelines and perform advanced data analysis to support business intelligence and data-driven decision-making. The ideal candidate will have a strong foundation in computer science principles, extensive experience with SQL and big data tools, and proficiency in cloud platforms and data visualization tools. Responsibilities Key Responsibilities: Exp: 5+ years Design, develop, and maintain robust, scalable ETL pipelines using Apache Airflow, DBT, Composer (GCP), Control-M, Cron, Luigi, and similar tools. Build and optimize data architectures including data lakes ...

About The Role Project Role : AI / ML Engineer Project Role Description : Develops applications and systems that utilize AI tools, Cloud AI services, with proper cloud or on-prem application pipeline with production ready quality. Be able to apply GenAI models as part of the solution. Could also include but not limited to deep learning, neural networks, chatbots, image processing. Must have skills : Machine Learning Operations Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Machine Learning Engineer/MLOps Expert, you will engage in the operationalization of Machine Learning Models that leverage artif...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Google Cloud Data Services Good to have skills : DevOps, Google Dataproc Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :Seeking a forward-thinking professional with an AI-first mindset to design, develop, and deploy enterprise-grade solutions using Generative and Agentic AI frameworks that drive innovation, efficiency, and business transformation.As an Application Developer, you will design, build, and configure applications to meet busine...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Microsoft Azure DevOps Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, facilitating discussions to address challenges, and guiding your team through the development process while ensu...

About The Role Project Role : Full Stack Engineer Project Role Description : Responsible for developing and/or engineering the end-to-end features of a system, from user experience to backend code. Use development skills to deliver innovative solutions that help our clients improve the services they provide. Leverage new technologies that can be applied to solve challenging business problems with a cloud first and agile mindset. Must have skills : PostgreSQL Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Project Role:Data Engineer Project Role Description:Build and maintain data pipelines, ensures data quality, an...

Dear Candidate, Greetings from TCS !!! TCS is hiring for AWS data engineer, please find the below JD.. Experience range – 4 to 10 years Location - Chennai/Pune Skills Required - AWS Glue, Redshift, Pyspark, Role& Responsibilities – · Strong hands-on experience in Python programming and Pyspark · Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda) · Experience working with Apache Spark and Hadoop ecosystem. · Experience in writing and optimizing SQL for data manipulations · Good Exposure to scheduling tools. Airflow is preferable. · Must – Have Data Warehouse Experience with AWS Redshift or Hive · Experience in implementing security measures for data protection. · Expertise to bu...

About The Role Project Role : Data Architect Project Role Description : Define the data requirements and structure for the application. Model and design the application data structure, storage and integration. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Architect, you will define the data requirements and structure for the application. Your typical day will involve modeling and designing the application data structure, storage, and integration, ensuring that the data architecture aligns with the overall business objectives and te...

Role Description Job Title: Backend Developer Location: India Experience: 5–8 years Role Overview We are seeking an experienced Backend Developer to design, develop, and maintain scalable backend systems for high-performance applications. The ideal candidate will have strong expertise in Python frameworks and databases, with exposure to modern cloud and containerization technologies. Key Responsibilities Design and implement backend services using Python (asyncio, FastAPI, Pydantic). Develop and maintain APIs with a focus on performance and scalability. Write unit and integration tests using pytest. Work with relational and NoSQL databases (MySQL, MongoDB) for data storage and retrieval. Opt...

Company Description Dataflow is the creator of the AI-ready data platform designed to maximize efficiency and flexibility for modern data teams. Our core mission is to simplify data workflow integration and management across all major cloud providers (AWS, Google Cloud, Azure) and private environments. We provide a complete, pre-configured data environment—including best-in-class open-source tools like Airflow, MLflow, VS Code, Jupyter, and Streamlit—that can be deployed in under thirty minutes. Role Overview We are seeking ambitious and entrepreneurial Business Development Consultants to join us on a commission-only basis. This role allows you to manage your own time, build professional net...

Project description This project is part of a strategic initiative to migrate legacy on-premises data systems to a modern, scalable cloud-based data platform using Snowflake on Azure. The goal is to enhance data accessibility, performance, and governance while enabling advanced analytics and automation.The resource will join an ongoing effort to accelerate the migration and modernization process, contributing to data pipeline development, orchestration, and optimization using tools like Airflow, DBT, and Docker, with strong emphasis on Python scripting and database engineering. Responsibilities Data Pipeline DevelopmentBuild and optimize ETL/ELT pipelines using Python, Airflow, and DBT to in...

Project description You'll be working in the Global Market Business Analytics team, focusing on creating the most data-driven, agile, productive, and technology-backed sales force in the industry. We deliver the next generation of tools and analytics to empower both leadership and sales people. Helping to view & deliver increased revenues through enhanced decision making and data-driven client engagement at scale.Are you motivated to deliver innovative and high-quality solutions for our Digital Platform? Are you a master of Java, Python, and interested in the coming frameworks, tools, and techniques? Have experience with Azure Cloud would be preferable. We're looking for experienced professi...

Platform Engineering Manager Experience: 8 - 12 Years Exp. Salary : Competitive Preferred Notice Period : Within 15 Days Shift : 9:00 AM to 6:00 PM IST Opportunity Type: Office , Pune, Maharashtra Placement Type: Permanent (*Note: This is a requirement for one of Uplers' Clients) Must have required skills: Airflow, Ansible, Datahub, GitLab CI/CD, Iceberg, Kubernetes (K8s), Spark Nexus Cognitive (One of Uplers' Clients) is Looking for: Platform Engineering Manager who is passionate about their work, eager to learn and grow, and who is committed to delivering exceptional results. If you are a team player, with a positive attitude and a desire to make a difference, then we want to hear from you...

Job Purpose As a key member of the DTS team, you will primarily collaborate closely with a global leading hedge fund on data engagements. Partner with data strategy and sourcing team on data requirements to design data pipelines and delivery structures. Essential Skills Desired Skills and Experience B.Tech/ M.Tech/ MCA with 7+ years of overall experience. Skilled in Python and SQL. Experience with data modeling, data warehousing, and building data pipelines. Experience working with FTP, API, S3 and other distribution channels to source data. Experience working with financial and/or alternative data products. Experience working with cloud native tools for data processing and distribution. Exp...

Job Description:- We are seeking a skilled and detail-oriented BIM Modeler (Mechanical) to join our design and engineering team in Bangalore. The ideal candidate will have strong expertise in CAD to BIM conversion, 3D modeling, and MEP coordination, with hands-on experience in Revit and other BIM tools. The role involves producing high-quality BIM models and drawings in alignment with project standards and client requirements . Key Skills (Mechanical BIM Modelling):- Must have experience as a BIM Modeler in projects from Gulf countries, especially Saudi Arabia and Dubai. - Proficient in HVAC system modeling including ducts, chillers, diffusers, AHUs, and piping. - Experience in 3D modeling a...

We are seeking an experienced GCP Data Engineer with strong expertise in designing, building, and managing scalable data pipelines and analytical solutions on Google Cloud Platform (GCP) . The ideal candidate will have a solid background in big data technologies, data warehousing, and cloud-based data architecture, with hands-on experience using GCP-native tools. Key Responsibilities: Design, develop, and maintain data pipelines and ETL processes on GCP using services like Dataflow, Dataproc, Pub/Sub, Cloud Functions, and Composer (Airflow) . Build and optimize data warehouses and data lakes using BigQuery, Cloud Storage, and Cloud SQL . Collaborate with data analysts, data scientists, and b...

Key Skills: Google BigQuery Must have worked on migration and pipeline creation SQL – Strong in both basic and advanced queries Python scripting Airflow / Cloud Composer Cloud platform exposure – GCP (primary), AWS (secondary acceptable) Terraform – for Infrastructure as Code (good to have) Cloud Functions and event-driven architecture Roles & Responsibilities: Develop and maintain scalable, cloud-native data processing pipelines on GCP. Work extensively on BigQuery, DataFlow, Pub/Sub, Cloud Storage , and Airflow for orchestration. Automate infrastructure using Terraform and follow agile development practices. Implement data solutions for enterprise-scale data lakes and data warehouses. Writ...

Position Title: Sr Engineering Manager – Infrastructure AI, Automation & Tools Position Location: Gurgaon Requisition ID: Our Global Technology team’s goal is to leverage technology and data to drive profitable growth, focus on enhancing customer experience and to further our purpose of ' Celebrating real connections through delicious, planet-friendly food '. McCain has embarked on an ambitious digital transformation across our business from Agriculture to Manufacturing and commercial capabilities to enhance our Customer obsession. As part of this transformation, we are making significant investments into our digital platforms, technology transformations and in building a data driven culture...

Job Brief: We are seeking an experienced Senior Data Engineer to design, build, and optimize our modern data ecosystem. The ideal candidate will have deep expertise in data architecture, pipeline orchestration, and data modeling across multi-layered architectures (bronze, silver, and gold layers). You’ll be responsible for architecting scalable and secure data solutions, ensuring smooth integration across systems, and driving the evolution of our data platform. Responsibilities: Architect and implement end-to-end data pipelines using Snowflake, Airflow, and dbt. Design and manage bronze, silver, and gold layers following Medallion architecture principles. Develop ETL/ELT frameworks and ensur...

Job Title: Data Engineer (Freelancer) Company: 360Digitmg Department: Information Technology / Data & Analytics Division Reporting To: Head – Data & Digital Infrastructure Role Summary The Data Engineer will be responsible for designing, developing, and maintaining robust data pipelines and architectures that support the Ministry’s digital transformation initiatives. The role involves integrating multiple data sources, ensuring data accuracy and availability, and supporting analytics, reporting, and evidence-based policy decisions. Key Responsibilities Design, build, and maintain data pipelines and ETL/ELT processes to collect, transform, and store data from various systems and external sour...

A project engineer for HVAC installation and commissioning specifically for clean rooms and AHU (Air Handling Units) is responsible for managing specialized HVAC systems designed to meet strict environmental control requirements. Specific Responsibilities in Clean Room and AHU Projects Oversee installation and commissioning of HVAC systems tailored for clean rooms, ensuring air cleanliness, temperature, humidity, and pressure controls meet regulatory standards. Manage installation and functioning of AHUs critical for air filtration, circulation, and maintaining clean room conditions. Coordinate with clean room design engineers, quality assurance teams, and contractors to ensure compliant HVA...

Department: Artificial Intelligence / Data ScienceReports To: Managing Director About the Role: We’re looking for a Senior AI/ML Engineer to design, build, and deploy cutting-edge machine learning and artificial intelligence solutions. The ideal candidate will have hands-on experience with scalable ML models, strong problem-solving abilities, and a passion for innovation in AI research and applications.Key Responsibilities:Design and optimize machine learning models and AI pipelines for real-world applications.Lead end-to-end projects — from data processing to model training, validation, and deployment.Implement and maintain MLOps workflows for scalable, reliable AI solutions.Collaborate wit...

NuStartz is seeking an experienced Senior Data Engineer to drive the modernization of our data infrastructure. The ideal candidate will play a key role in designing, building, and optimizing data pipelines as we migrate to Google Cloud Platform (GCP)—leveraging Dataform for orchestration and transformation. You will collaborate with multiple teams to create a scalable, efficient, and future-ready data environment that supports advanced analytics and business intelligence initiatives. Key Responsibilities Design, develop, and maintain scalable data pipelines and ETL/ELT workflows. Lead the migration of existing workflows to GCP’s Dataform and establish a robust data pipeline framework. Build ...

Job Title: Tech Lead Data Engineering (DBT) Location: Chennai (On-Site) Experience: 7+ Years Position Type: Full-Time Shift Timings: 2 - 11 PM Skillset: Data Engineering, ETL Pipelines, DBT (Data Build Tool / Data Built Tool), Python, SQL About the Role: We are seeking an experienced Data Engineering Lead (DBT Tech Lead) to design, build, and lead scalable data transformation and pipeline solutions within a modern data stack environment. The ideal candidate will have deep experience in ETL and Data Engineering with recent hands-on expertise in DBT (Data Build Tool) for data modeling, orchestration, and transformation. This role requires a strong command of SQL, data pipeline optimization, an...