19344 Airflow Jobs - Page 4

Position Overview We are seeking a hands-on Data Engineering Architect to design and build scalable data pipelines, implement cutting-edge Generative AI features, and architect robust data solutions. This role requires a technical leader who can translate business requirements into sophisticated data architectures while actively contributing to code development and system implementation. Roles & Responsibilities Architecture & Design Design and implement end-to-end data pipelines supporting batch and real-time processing Architect scalable data solutions using modern cloud-native patterns and microservices Develop comprehensive data strategies integrating traditional databases with cloud dat...

Job Requisition ID # 25WD91419 Position Overview We are seeking a highly experienced Principal Engineer to lead the design, development, and evolution of our Batch Processing platform , which powers Autodesk’s Analytics Data Platform (ADP). This role requires deep technical expertise in distributed data systems, large-scale pipeline orchestration, and hands-on leadership in shaping next-generation data platform capabilities. You will partner closely with Engineering Managers, Architects, Product teams, and Partner Engineering to modernize our data lakehouse architecture, deliver highly reliable data pipelines, and establish technical excellence across ingestion, processing, and governance. R...

Lead Data Scientist Our Client: Founded in 2020, our client is an industry-leading, first-of-its-kind in India, digital healthcare data platform and exchange, infused with AI/ML capabilities, delivering solutions to stakeholders in all segments of the healthcare sector. Job Title: Lead Data Scientist Education: Btech (Degree in Data Science Plus) Experience: 8 - 10 Years Location: Bangalore About the Role: We are developing the next-generation automated health insurance claims processing platform, leveraging AI/ML, deep learning, NLP, OCR, and LLM-powered intelligence. As a Lead Data Scientist, you will drive the design, development, deployment, and optimisation of AI models that power large...

Qualifications B.Tech./M.Tech/M.S./PhD in Computer Science, Statistics, Mathematics, Economics, or related quantitative field (advanced degree preferred). Minimum 8+ years of experience in data analytics, business intelligence, or quantitative research, including at least 3 years leading analytics initiatives. Key Responsibilities Oversee the design and implementation of analytics frameworks for platform performance monitoring and user behaviour analysis, aligning with SIDH’s objectives as a Digital Public Infrastructure. Oversee development of real-time dashboards for tracking skill acquisition, certification rates, employment outcomes, and scheme effectiveness across government programs. E...

To excel as an Embedded Designer for a digital drainage system, a candidate must possess a "T-shaped" skill set: deep expertise in low-level firmware and hardware, combined with a broad understanding of IoT security and medical regulatory standards. Here is the essential skill set categorized by domain. 1. Core Embedded & Hardware Skills * Languages: Expert C (for bare-metal and RTOS) and C++ (for modular system architecture). * Microcontrollers: Proficiency with ARM Cortex-M series (STM32, Nordic nRF52/91) or TI MSP430. * Peripheral Mastery: Extensive experience with I2C, SPI, UART, and ADC for interfacing with high-precision pressure and flow sensors. * Power Management: Knowledge of desig...

NetSPI® pioneered Penetration Testing as a Service (PTaaS) and leads the industry in modern pentesting. Combining world-class security professionals with AI and automation, NetSPI delivers clarity, speed, and scale across 50+ pentest types, attack surface management, and vulnerability prioritization. The NetSPI platform streamlines workflows and accelerates remediation, enabling our experts to focus on deep dive testing that uncovers vulnerabilities others miss. Trusted by the top 10 U.S. banks and Fortune 500 companies worldwide, NetSPI has been driving security innovation since 2001. NetSPI is headquartered in Minneapolis, MN, and available on AWS Marketplace. Follow us on LinkedIn and X. ...

Job Title: Data Analyst Location : Remote Working Hours: Flexible hours (minimum 40 hours per week), as per UK shift timings Experience: 3–5 years Salary: Up to ₹12 LPA (based on experience and skills) Language: Excellent English (written & verbal) Job Overview We are looking for an experienced Data Analyst who can transform raw data into meaningful insights that drive business decisions. In this role, you will work closely with data engineers, analytics engineers, and business stakeholders to build reliable data models, maintain analytics-ready datasets, and deliver insights through dashboards and reports. The ideal candidate has strong SQL skills, hands-on experience with cloud data wareho...

Company Description Truestar Air Systems is a leading manufacturer specializing in factory-fabricated ducts and air distribution products for modern ventilation and clean air solutions. Committed to quality, innovation, and energy efficiency, Truestar Air Systems delivers products that enhance airflow, improve indoor air quality, and support sustainable building systems. Servicing diverse sectors, including commercial and industrial, the company provides high-performance solutions to optimize ventilation and improve building efficiency. With an emphasis on creating healthier spaces, Truestar remains at the forefront of delivering energy-saving and reliable systems. Role Description This is a...

This role is for one of Zepcruit's clients. Role & Responsibilities We are looking for a Senior MLOps Engineer with 8+ years of experience building and managing production-grade ML platforms and pipelines. The ideal candidate will have strong expertise across AWS, Airflow/MWAA, Apache Spark, Kubernetes (EKS), and automation of ML lifecycle workflows. You will work closely with data science, data engineering, and platform teams to operationalize and scale ML models in production. Key Responsibilities: Design and manage cloud-native ML platforms supporting training, inference, and model lifecycle automation. Build ML/ETL pipelines using Apache Airflow / AWS MWAA and distributed data workflows ...

Our Client: Founded in 2020, our client is an industry-leading, first-of-its-kind in India, digital healthcare data platform and exchange, infused with AI/ML capabilities, delivering solutions to stakeholders in all segments of the healthcare sector. Job Title: Lead Data Scientist Education: Btech (Degree in Data Science Plus) Experience: 8 - 10 Years Location: Bangalore About the Role: We are developing the next-generation automated health insurance claims processing platform, leveraging AI/ML, deep learning, NLP, OCR, and LLM-powered intelligence. As a Lead Data Scientist, you will drive the design, development, deployment, and optimisation of AI models that power large-scale claims decisi...

Job Title: Data Engineer Experience: 2–4 Years Location: New Delhi (Hybrid) Required Skills: Fivetran, Terraform, CI/CD Job Description We are looking for a Data Engineer with hands-on experience in building and managing data ingestion pipelines using Fivetran , Python , and cloud data platforms. The role focuses on ingesting data from multiple source systems into the Bronze (raw) layer of an enterprise data ecosystem, ensuring data accuracy, reliability, and scalability. Key Responsibilities Data Ingestion & Pipeline Development Develop and deploy custom Fivetran connectors using Python for non-native data sources Configure and manage standard Fivetran connectors for CRM, SaaS, ERP, and ope...

TCS has been a great pioneer in feeding the fire of Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together. TCS Hiring for AWS Data Engineer Experience Range: - 5 years & Above Location: Chennai Must-Have Strong hands-on experience in Python programming and PySpark Experience using AWS services (RedShift, Glue, EMR, S3 & Lambda) Experience working with Apache Spark and Hadoop ecosystem. Experience in writing and optimizing SQL for data manipulations. Good Exposure to scheduling tools. Airflow is preferable. Must – Have Data Warehouse Experience with AWS Redshift or Hive Experience in implementing security measures for data ...

Job Description: We are a rapidly expanding AI startup that is transforming digital advertising with groundbreaking AI technology and innovative solutions. We are seeking a seasoned and visionary Principal Data Engineer & Tech Lead Manager to join our team and play a pivotal role in building and leading our data infrastructure that powers the future of advertising. As a Principal Data Engineer & Tech Lead Manager, you will be responsible for architecting and leading the development of large-scale data platforms that process petabytes of consumer behavioral data. You will take ownership of the entire data ecosystem, from ingestion to transformation to serving, ensuring that our machine learni...

We're Nagarro. We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale across all devices and digital mediums, and our people exist everywhere in the world (17500 experts across 39 countries, to be exact). Our work culture is dynamic and non-hierarchical. We are looking for great new colleagues. That is where you come in! REQUIREMENTS: Total experience: 8+ years. Excellent knowledge and experience in Azure data engineer role. Strong working experience with architecture and development in Spark, Python, Azure Databricks, Airflow and DBT, SQL Server. As the Analytics Engineer on ...

Job Title: AWS Data Engineer Location: Chennai Experience: 5 10 Years Interview Mode: Face-to-Face (Walk-in) Walk-in Date: 10th Jan 2026 Time: 10:30 AM – 3:00 PM Mandatory Skills AWS (S3, Glue, EMR, Redshift, Lambda) Python SQL (Complex Queries) PySpark Databricks Data Modeling & Data Warehousing ETL / ELT Pipelines Job Summary Looking for an experienced AWS Data Engineer with strong hands-on expertise in Python, PySpark, Databricks, SQL, and AWS to build and maintain scalable data pipelines. Contact gopi.c@acesoftlabs.com 9701923036

WHO ARE WE We are a bunch of super enthusiastic, passionate, and highly driven people, working to achieve a common goal! We believe that work and the workplace should be joyful and always buzzing with energy! CloudSEK, one of India's most trusted Cyber security product companies, is on a mission to build the world's fastest and most reliable AI technology that identifies and resolves digital threats in real-time. The central proposition is leveraging Artificial Intelligence and Machine Learning to create a quick and reliable analysis and alert system that provides rapid detection across multiple internet sources, precise threat analysis, and prompt resolution with minimal human intervention....

Experience: 5+ Years Location: Hyderabad /Hybrid Employment Type: Full-time About ServCrust ServCrust is a fast-growing D2C SaaS platform reshaping the construction materials and logistics ecosystem using AI-led supply chain intelligence, geo-analytics, and credit-risk insights . We process real-time order, logistics, and IoT data across multiple states to deliver insights on pricing, supplier performance, delivery optimization, and more Role Overview We're looking for an experienced Data Engineer to build and scale our end-to-end data pipelines that power dashboards, AI models, and decision systems across our microservices-driven architecture. You'll collaborate closely with Data Science, P...

Role Overview: As a talented Data & AI/ML Engineer with strong hands-on experience in the AWS ecosystem, you will be responsible for working on exciting data and machine learning projects. Your role will involve building pipelines, deploying models, and leveraging AWS services to deliver scalable solutions. Key Responsibilities: - Data Engineering: Execute ETL processes, perform data modeling, and work with tools such as AWS Glue, Spark, and Airflow. - Machine Learning: Implement machine learning algorithms using SageMaker, TensorFlow, PyTorch, and Scikit-learn. - AWS Services: Utilize Redshift, S3, Lambda, EC2, Kinesis, and IAM for various tasks. - Programming: Proficient in Python and SQL ...

At Arctic Wolf, we're redefining the cybersecurity landscape. With our employee Pack members, spread out globally, committed to setting new industry standards. Our accomplishments speak for themselves, from our recognition in the Forbes Cloud 100 , CNBC Disruptor 50 , Fortune Future 50 , and Fortune Cyber 60 to winning the 2024 CRN Products of the Year award. We're proud to be named a Leader in the IDC MarketScape for Worldwide Managed Detection and Response Services and earning a Customers Choice distinction from Gartner Peer Insights . Our Aurora Platform also received CRN's Products of the Year award in the inaugural Security Operations Platform category. Join a company that's not only le...

Role Overview: As an Engineer/ Sr Engineer/ Lead Engineer / Principal Engineer in SMART Solutions & AI Delivery at Futuristic Underwriters Pvt. Ltd., you will be instrumental in building the future of insurance with AI. Join the India Digital Innovation Unit to design and deploy AI-powered solutions that revolutionize underwriting, claims, and operational efficiency for a leading global insurer. Whether you are an AI Engineer, Senior Engineer, or Principal Engineer with 3 to 15 years of experience, your role will involve hands-on model building and AI platform architecture to drive impactful outcomes. Key Responsibilities: - Design, train, and deploy ML models for risk scoring, underwriting ...

As a Senior NodeJS Data Engineer at our project located in Noida/Gurgaon, you will have the opportunity to contribute your expertise in data engineering and play a key role in building transformation pipelines and ensuring data quality and reliability. **Key Responsibilities:** - Utilize your 5+ years of hands-on experience in data engineering to work with Snowflake or similar cloud data warehouses, Airflow or other orchestration tools, SQL, and Python. - Build transformation pipelines using Python, Airflow, and Snowflake Stored procedures. - Develop optimized SQL and Python scripts for data manipulation and ETL processes. - Monitor and maintain data quality, observability, and pipeline reli...

Company Description Work with Us. Change the World. At AECOM, we're delivering a better world. Whether improving your commute, keeping the lights on, providing access to clean water, or transforming skylines, our work helps people and communities thrive. We are the world's trusted infrastructure consulting firm, partnering with clients to solve the world’s most complex challenges and build legacies for future generations. There has never been a better time to be at AECOM. With accelerating infrastructure investment worldwide, our services are in great demand. We invite you to bring your bold ideas and big dreams and become part of a global team of over 50,000 planners, designers, engineers, ...

Company Description We make digital 𝐡𝐮𝐦𝐚𝐧™ by combining human-centered design with real-time Analytics, AI, Cognitive Technology & Automation to create exceptionally engineered Brand Experiences! Sutherland is an experience-led digital transformation company. Our mission is to deliver exceptionally engineered experiences for customers and employees today, that continue to delight tomorrow. For over 35 years, we have cared for our customers’ customers, delivering measurable results and accelerating growth. Our proprietary, AI-based products and platforms are built using robust IP and automation. We are a team of global professionals, operationally effective, culturally meshed, and committed t...

Job Description Strategic Imperative: The Analytics Engineer I plays a key role in supporting the organization's business intelligence and reporting infrastructure by transforming raw data into trusted, actionable insights. This individual will focus on building curated data models, developing dashboards, and enabling accurate and timely reporting for business stakeholders. They will work under the guidance of experienced Analytics Engineers to design semantic layers, validate data logic, and ensure analytics outputs are aligned with business needs. This role offers a strong foundation in modern analytics engineering practices, including hands-on experience with tools like Snowflake Data Clo...

As a Data Engineer at Muoro.io, you will play a crucial role in designing, building, and optimizing scalable data pipelines and platforms within the AWS data ecosystem. Your expertise in modern data architectures and strong analytical skills will be key to delivering high-quality and reliable data solutions. Key Responsibilities: - Design, develop, and maintain robust data pipelines and ETL workflows using AWS tools such as Glue, Kinesis, Redshift, S3, and Data Lake architectures. - Utilize SQL and Databricks for processing, transforming, and analyzing large datasets effectively. - Implement data orchestration and workflow automation using tools like Airflow or Step Functions. - Ensure data ...