682 Apache Airflow Jobs

As an experienced Data Engineer with 6+ years of experience, your role will involve: - Designing and implementing modern data lakehouse architectures (Delta Lake, or equivalent) on cloud platforms like AWS, Azure, or GCP. - Defining data modeling, schema evolution, partitioning, and governance strategies for high-performance and secure data access. - Owning the technical roadmap for scalable data platform solutions, aligned with enterprise needs and future growth. - Providing architectural guidance and conducting code/design reviews across data engineering teams. - Building and maintaining reliable, high-throughput data pipelines for ingestion, transformation, and integration of structured, ...

We are looking for lead or principal software engineers to join our Data Cloud team. Our Data Cloud team is responsible for the Zeta Identity Graph platform, which captures billions of behavioural, demographic, environmental, and transactional signals, for people-based marketing. As part of this team, the data engineer will be designing and growing our existing data infrastructure to democratize data access, enable complex data analyses, and automate optimization workflows for business and marketing operations. Job Description: Essential Responsibilities: As a Lead or Principal Data Engineer, your responsibilities will include: Building, refining, tuning, and maintaining our real-time and ba...

Primary Skills: Over 8 years of experience in L3 production support with deep domain expertise in Investment Management and BFSI Skilled in Python, ReactJS, Snowflake, SQL, and JavaScript, with strong proficiency in both Linux and Windows operating systems Hands-on experience with Apache Airflow for orchestrating data workflows ITIL Process: Effectively coordinate release activities across internal and external teams, ensuring seamless deployment in collaboration with Change Management Adept at troubleshooting and resolving complex issues with speed and precision Proactively engage with cross-functional teams to drive issue resolution using analytical thinking and industry best practices Acc...

Contract Duration : 4 Months (Extendable based on Performance) Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 7+ Years Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-c...

Contract Duration : 4 Months (Extendable based on Performance) Job Timings : India Evening Shift (till 11 : 30 PM IST) Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-cloud environments (AWS, Azure, ...

Contract Duration : 4 Months +Exendible based on Performance Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 4+ Years Job Description : We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment. Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow orchestration using Airflow or similar frameworks. - Design, implem...

Contract Duration : 4 Months (Extendable based on Performance) Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 7+ Years Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-c...

Contract Duration : 4 Months +Exendible based on Performance Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 4+ Years Job Description : We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment. Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow orchestration using Airflow or similar frameworks. - Design, implem...

Contract Duration : 4 Months +Exendible based on Performance Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 4+ Years Job Description : We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment. Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow orchestration using Airflow or similar frameworks. - Design, implem...

5 to 7 years of experience in data engineering Architect and maintain scalable, secure, and reliable data platforms and pipelines Design and implement data lake/data warehouse solutions such as Redshift, BigQuery, Snowflake, or Delta Lake Build real-time and batch data pipelines using tools like Apache Airflow, Kafka, Spark, and DBT Ensure data governance, lineage, quality, and observability

As a Java Full Stack Lead Developer at Dedalus, you will play a crucial role in modern web development, backend technologies, and cloud infrastructure. You will have the opportunity to take ownership of complex projects, mentor junior developers, and contribute to both optimizing existing systems and developing new features. Working in a team environment, you will have the chance to make a profound impact in the healthcare sector. Key Responsibilities: - Design and implement backend solutions using Java and Python, with additional experience in PHP and the Laravel Framework being advantageous. - Develop and maintain scalable front-end applications utilizing Angular. - Lead development effort...

Required Skills: Data Engineer, AWS, Spark, Apache Airflow, Kafka, Snowflake, DBT, Flink, CI / CD Pipelines, Apache Iceberg, Glue

Were Hiring: Senior Full Stack Developers / Technical Leads (MERN + Modern JS Stack)(Experience: 8+ Years | Rapid hiring with 20+ open positions ) Locations: Pune / Mohali / Gurugram / Navi Mumbai / Bengaluru Shift: Night Shift (6 PM 3 AM IST) Employment Type: Full-Time Clients: Fortune 500 Companies Industry: Digital Consulting / Fortune 500 Clients (Staffing via Hatchtra Innotech Pvt. Ltd.) About us: We are a premier staffing and workforce solutions provider, working with Fortune 500 companies and global enterprises to build modern Martech and Digital Analytics teams. About the Role Were looking for experienced Full Stack Developers / Technical Leads (majorly backend-focused) to design, de...

Python Lead Developer (Contract Position) Location : Chennai Hybrid (3 Days a Week in Office) Employment Type: Contract Shift : UK Shift (if applicable) Job Summary We are looking for a highly skilled Python Lead Developer with strong expertise in Python, SQL, AWS, and Apache Airflow. The ideal candidate will lead a team of developers to build scalable data pipelines, backend systems, and cloud-based solutions, ensuring high performance, maintainability, and adherence to best practices. Key Responsibilities Lead and mentor a team of Python developers, ensuring delivery of high-quality software solutions. Design, develop, and optimize data pipelines and backend systems using Python and Airflo...

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...

In this role, you will: (Principal Responsibilities) As a key member of the technical team alongside Engineers, Data Analysts and Business analysts, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process: Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and monitoring Liaison with B...