10863 Airflow Jobs - Page 22

Logic Pursuits is seeking an experienced Senior Data Engineer to lead the design and implementation of scalable, high-performance data pipelines using Snowflake and dbt . You will define architectural best practices, optimize data platforms, and mentor junior engineers while collaborating with clients to deliver robust, production-grade data solutions. Key Responsibilities Architect and implement modular, test-driven ELT pipelines using dbt on Snowflake . Design layered data models (staging, intermediate, marts / medallion architecture) aligned with dbt best practices. Lead ingestion of structured & semi-structured data (APIs, flat files, cloud storage like Azure Data Lake, AWS S3 ) into Sno...

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Databricks Unified Data Analytics Platform, Cucumber Good to have skills : Python (Programming Language), Apache Airflow Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary: As an Application Developer, you will engage in the design, construction, and configuration of applications tailored to fulfill specific business processes and application requirements. Your typical day will involve collaborating with various stakeholders to gather requirements, developing...

Position Overview We are seeking an accomplished AI Architect with 10–15 years of experience in Artificial Intelligence, Machine Learning, and Data Science. This is a part-time strategic role designed for a highly experienced professional who can define the architectural vision, provide technical leadership, and guide the implementation of cutting-edge AI solutions across the organization. The ideal candidate will possess extensive expertise in both data science methodologies and AI engineering practices, with the ability to translate business requirements into scalable, secure, and efficient AI systems. Key Responsibilities ● Design, build, and optimize end-to-end AI/ML solutions, from data...

Job Title: Part-Time Senior AI Architect / Developer Location: Remote Type: Part-Time / Consulting About the Role We are looking for an experienced AI Architect (10–15 years) to define and lead our AI strategy. This is a part-time, high-impact role for a professional with deep expertise in Artificial Intelligence, Machine Learning, and Data Science. You’ll provide architectural vision, guide development, and ensure scalable, secure, and innovative AI solutions. Responsibilities Design and optimize AI/ML solutions from data ingestion to production. Build advanced ML, deep learning, and generative AI models. Work with large datasets, pipelines, and automation. Deploy and maintain AI systems in...

Responsibilities: Key Responsibilities: 1. Design and implement data pipelines for seamless data ingestion. 2. Utilize AWS technologies, including S3, Glue, and Lambda, for effective data management. 3. Collaborate with cross-functional teams to enhance data processes using Python, PySpark, and SQL. 4. Implement CI/CD deployments for streamlined development processes. 5. Understand Data Warehouse concepts to ensure efficient data storage and retrieval. 6. Orchestrate data workflows using AWS Step Functions and Apache Airflow. 7. Able to create data pipeline using AWS services and Snowflake with DBT. 8. Able to utilize Snowflake concepts to streamline data processing and reduce bottlenecks of...

We are looking for a skilled Data Engineer with 7 to 10 years of experience to join our team in Bangalore, Hyderabad, Chennai, and Pune. The ideal candidate will have expertise in data engineering, Azure cloud, Snowflake, and Snowflake ELT methodologies. Roles and Responsibility Design and develop scalable data pipelines using Azure cloud and Snowflake. Implement ETL processes on Azure and manage data management tasks. Develop automation scripts using Python, Scala, or other languages. Collaborate with cross-functional teams to ensure seamless data integration. Ensure data integrity and accuracy during migration efforts. Optimize data processing workflows for improved efficiency. Job Require...

We are looking for a skilled Hadoop Admin with 7 to 12 years of experience, located in Hyderabad, Bangalore, Chennai, and Bhubaneshwar. The ideal candidate will have hands-on experience in building EKS clusters, Spark on EKS, AWS (EMR, S3, RDS), Python as programming skills, Shell scripting, and any CI/CD. Roles and Responsibility Manage and maintain large-scale Hadoop clusters for high availability and performance. Design and implement scalable data processing pipelines using Spark and Airflow instances. Integrate Ranger and Hive Metastore services in EKS for secure data storage and access. Collaborate with cross-functional teams to identify and resolve technical issues. Develop and impleme...

We are looking for a skilled professional with 5-10 years of experience to join our team as a GCP expert. The ideal candidate will have a strong background in BigQuery, GCP, and coding languages like Java, Python, and Hadoop. This position is available in Bangalore, Hyderabad, Chennai, Pune, Noida, and Gurgaon. Roles and Responsibility Design and develop scalable and efficient data pipelines using BigQuery and GCP. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data architectures using Cloud SQL and Apache Airflow. Ensure high-quality data processing and analysis by implementing robust testing and validation framework...

Instrument Service Engineer 📍 Location: Gurugram 🏢 Company: Skybound Projects India Pvt. Ltd. 🌟 Experience - 6 months to 1 year We are hiring an Instrument Service Engineer to handle installation, validation, and servicing of laboratory instruments while ensuring excellent customer support. Responsibilities Install, configure, and demonstrate lab instruments at client sites. Provide post-sales support: troubleshooting, maintenance & repairs. Prepare technical documentation (IQ, OQ, PQ, DQ). Conduct site inspections & ensure compliance with safety/quality standards. Coordinate with internal teams for smooth project execution. Qualifications Diploma / B.E. / B.Tech in Instrumentation, Electron...

We are looking for a skilled Data Engineer with 4 to 7 years of experience to join our team in Bangalore. The ideal candidate will have expertise in Python, SQL, AWS, Spark, and Big Data processing frameworks. Roles and Responsibility Design and develop scalable data pipelines using Python, Scala, or Java. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data systems using Hadoop and Big Data processing frameworks. Ensure data quality and integrity by implementing robust testing and validation procedures. Optimize data storage and retrieval processes for improved performance and efficiency. Participate in code reviews t...

We are looking for a skilled Lead Administrator with expertise in Airflow Admin to join our team. The ideal candidate will have 8+ years of experience and be based in Bangalore, Pune, Mumbai, Hyderabad, Chennai, Gurgaon, or Noida. Roles and Responsibility Manage and maintain the Airflow workflow management system. Design and implement scalable architectures using Docker, Kubernetes, and container-based microservices. Develop and execute SQL, PL/SQL scripts, and PowerShell scripts to automate tasks. Collaborate with cross-functional teams to identify and prioritize project requirements. Ensure seamless integration of Airflow with databases such as Postgres, Mongo, and RabbitMQ. Troubleshoot a...

We are looking for a skilled professional with 4 to 12 years of experience in the field, located in Bangalore. The ideal candidate should have strong skills in Bigquery, GCP, ETLs, SQL writing, Python Programming, PostgreSQL and MongoDB, Data Build Tool (DBT), Airflow, Google Cloud Composer, Google Cloud PubSub, Data Extraction, Data Transformation, and DBT tool. Roles and Responsibility Design and develop scalable data pipelines using GCP services such as Bigquery, Cloud Storage, and Pubsub. Develop and maintain large-scale data warehouses and data lakes on GCP. Collaborate with cross-functional teams to identify and prioritize project requirements. Ensure data quality and integrity by impl...

At Index Exchange, we’re reinventing how digital advertising works—at scale. As a global advertising supply-side platform, we empower the world’s leading media owners and marketers to thrive in a programmatic, privacy-first ecosystem. We’re a proud industry pioneer with over 20 years of experience accelerating the ad technology evolution. Our proprietary tech is trusted by some of the world’s largest brands and media owners and plays a crucial role in keeping the internet open, accessible, and largely free. We process more than 550 billion real-time auctions every day (in comparison, Google processes 8.5 billion searches per day) with ultra-low latency. Our platform is vertically integrated ...

We are looking for a skilled professional with 5-10 years of experience to join our team as a GCP Databases expert in Bangalore, Hyderabad, Chennai, Pune, Noida, and Gurgaon. The ideal candidate will have a strong background in GCP migration, database migration, and native GCP databases. Roles and Responsibility Design and implement scalable and efficient GCP databases for large-scale applications. Develop and maintain database architectures using CloudSQL, MySQL, PostgreSQL, and SQL Server. Collaborate with cross-functional teams to identify and prioritize database requirements. Ensure high availability and performance of GCP databases through monitoring and optimization techniques. Impleme...

Overview We're looking for a data-obsessed explorer who can build and maintain pipelines that collect, clean, and enhance large volumes of data, then apply AI tools to keep it accurate, useful, and ready for analysis. This is initially a project-based role with the possibility of evolving into a full-time contract based on performance and business needs. Key Responsibilities Data Acquisition & Scraping Design, develop, and maintain scalable web-scraping systems and APIs to collect structured and unstructured data from diverse sources. Ensure compliance with data privacy laws (GDPR, CCPA) and site-specific terms of service. Data Enrichment & Transformation Implement pipelines to clean, normal...

Job Description: Sales and Marketing Specialist (HVAC & Cleanroom Solutions) Company: Syntec Airflow Systems Location: Gurugram, Haryana Job Type: Full-time About Syntec Airflow Systems Syntec Airflow Systems is a leading provider of turnkey solutions in HVAC (Heating, Ventilation, and Air Conditioning) and cleanroom technology. We specialize in designing, engineering, and executing state-of-the-art controlled environments for critical industries, including pharmaceuticals, biotechnology, healthcare, and electronics. We are looking for a dynamic and technically-minded individual to join our growing team and drive our business forward. Position Overview We are seeking a motivated and detail-o...

Company Description Syntec Airflow Systems is a pioneering company in manufacturing, trading, and providing services for Air Handling Units, Clean Room Equipment, Ducting, Modular Operation Theaters, and Clean Room Puff Partitions. Our products are developed under the direction of skilled professionals using modern technology and high-quality raw materials sourced from certified vendors. We offer turnkey solutions for cleanrooms and HVAC systems adhering to ASHRAE, SMACNA, and ISO 14644 standards. Our expertise covers various industries including healthcare, medical devices, agriculture, electronics, and more, making us a comprehensive provider for all cleanroom and HVAC needs. Role Descript...

IMEA (India, Middle East, Africa) India LIXIL INDIA PVT LTD Employee Assignment Fully remote possible Full Time 1 May 2025 Title Data Engineer Job Description A Data Engineer is responsible for designing, building, and maintaining large-scale data systems and infrastructure. Their primary goal is to ensure that data is properly collected, stored, processed, and retrieved to support business intelligence, analytics, and data-driven decision-making. Key Responsibilities Design and Develop Data Pipelines: Create data pipelines to extract data from various sources, transform it into a standardized format, and load it into a centralized data repository. Build and Maintain Data Infrastructure: Des...

Director – Data Science and AI Location: Mumbai or Bangalore About Traya Traya is a health-tech company that treats hair loss end-to-end through a personalized program combining dermatology, Ayurveda, nutrition, and behavioral science. We own the entire pathway — assessment, regimen design, coaching, refills, and protocol adjustments — powered by an adherence engine and outcomes data that improve results over time. As Traya scales into an omnichannel health platform (web, app, clinics, tele-coaching), data science is the engine powering personalization, retention, and efficiency . Why This Role Exists This is a hands-on builder role for a leader who wants to take models from notebook to prod...

Job Title: Data Engineer Location: Chennai (Hybrid) Experience: 7–9 Years (STRICTLY) Employment Type: Permanent Notice Period: Immediate Joiners Only About the Company Our client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success, they empower clients and society to move confidently into the digital future. Job Description • 6+ years of experience designing and building data pipelines using Apache Spark, Databricks or equivalent bigdata frameworks. Hands-on expertise with streaming and messaging systems such as ...

Job Description We are looking for a Data Engineer with strong skills in AWS and data engineering tools to support and monitor our data pipelines and systems. The candidate will be responsible for monitoring, troubleshooting, and ensuring smooth execution of ETL/ELT workflows. Key Responsibilities Monitor and maintain AWS services like Redshift, S3, RDS, CloudWatch, AppFlow, EMR, Glue, and DMS. Monitor, schedule, and troubleshoot data workflows in Airflow. Ensure smooth execution of ETL/ELT jobs. Work with SQL and Python for data validation and troubleshooting. Raise alerts and coordinate with teams in case of failures. Required Skills Hands-on experience with AWS (Redshift, S3, RDS, CloudWa...

Our client is prominent Indian multinational corporation specializing in information technology (IT), consulting, and business process services and its headquartered in Bengaluru with revenues of gross revenue of ₹222.1 billion with global work force of 234,054 and listed in NASDAQ and it operates in over 60 countries and serves clients across various industries, including financial services, healthcare, manufacturing, retail, and telecommunications. The company consolidated its cloud, data, analytics, AI, and related businesses under the tech services business line. Major delivery centers in India, including cities like Chennai, Pune, Hyderabad, and Bengaluru, kochi, kolkatta, Noida. Job Ti...

About Company : They balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation. We guide customers from what’s now to what’s next by unlocking the value of their data and applications to solve their digital challenges, achieving outcomes that benefit both business and society. About Client: Our client is a global digital solutions and technology consulting company headquartered in Mumbai, India. The company generates annual revenue of over $4.29 billion (₹35,517 crore), reflecting a 4.4% year-over-year growth in USD terms. It has a workforce of around 86,000 professionals operating in more than 40 countries and se...

Position: Python Developer Location: Remote (India) Salary: 80-90k pm Experience: 4+ years Job Description: We’re looking for a Python Developer with solid hands-on experience in job and web data scraping, AI-enabled data processing, and building scalable ETL pipelines. You’ll design, implement, and operate scraping and enrichment systems that feed recruitment and analytics products. Familiarity with Aspen/Webspidermount and Kadoa is a plus. QA-minded engineers who care about data accuracy and observability will thrive in this role. Key Responsibilities: Design, develop, and maintain AI-powered web and job-scraping pipelines. Extract structured and unstructured data from job boards, company ...

About the Role: We are looking for a Senior Data Engineer with 6+ years of experience in designing, developing, and maintaining robust data pipelines. The role involves supporting and optimizing SQL Server SSIS ETL workflows, while also driving the transition to Microsoft Fabric pipelines. The ideal candidate will be comfortable with legacy ETL support and highly skilled in building modern, cloud-native data workflows in Fabric. 🔧 Key Responsibilities: Provide production support and maintenance for existing SQL Server SSIS ETL jobs. Design, develop, and migrate ETL workflows from SSIS to Microsoft Fabric. Build, test, and optimize Fabric pipelines, Dataflows, Eventstream, Notebooks, and Lake...