974 Apache Airflow Jobs - Page 12

Educational Requirements Bachelor of Engineering,Bachelor Of Technology Service Line Cloud & Infrastructure Services Responsibilities A day in the life of an Infoscion As part of the Infosys delivery team, your primary role would be to ensure effective Design, Development, Validation and Support activities, to assure that our clients are satisfied with the high levels of service in the technology domain. You will gather the requirements and specifications to understand the client requirements in a detailed manner and translate the same into system requirements. You will play a key role in the overall estimation of work requirements to provide the right information on project estimations to T...

Job Title : Python Lead Developer Location : Chennai - Hybrid (3 Days a Week in Office) Experience : 8- 10 Years Employment Type : Contract Shift : UK Shift (if applicable) Job Summary We are looking for a highly skilled Python Lead Developer with strong expertise in Python, SQL, AWS, and Apache Airflow. The ideal candidate will lead a team of developers to build scalable data pipelines, backend systems, and cloud-based solutions, ensuring high performance, maintainability, and adherence to best practices. Key Responsibilities Lead and mentor a team of Python developers, ensuring delivery of high-quality software solutions. Design, develop, and optimize data pipelines and backend systems usi...

In a People Leadership role at Eightfold, you will have the opportunity to lead and mentor a team of talented engineers. Your focus will be on coaching, mentoring, and performance management to create a high-performing team environment. You will be responsible for owning, training, building, and deploying cutting-edge deep learning models across all Eightfold products. Additionally, you will collaborate on various ideas to ensure the existence of a highly reliable, world-class platform to run machine learning models. Your role will involve building high-performance, flexible infrastructure and services that can evolve rapidly to handle new technologies, techniques, and modeling approaches. Y...

As a Lead Data Engineer at Rearc, you will be responsible for establishing and maintaining technical excellence within the data engineering team. Your expertise in data architecture, ETL processes, and data modeling will play a crucial role in optimizing data workflows for efficiency, scalability, and reliability. Collaboration with cross-functional teams to design and implement robust data solutions will be essential. **Key Responsibilities:** - Collaborate with Stakeholders: Work closely with internal and external stakeholders to understand data challenges and design tailored solutions. - Drive DataOps Practices: Lead with a DataOps mindset using modern tools to build scalable, efficient, ...

As a Backend Developer at Citi, you will have the opportunity to build the foundational backend systems for "Citi Assist", a Generative AI assistant that aims to reach every Citi employee globally. You will play a crucial role in shaping a high-visibility platform and defining the standards for how a global bank can safely and effectively adopt this technology at scale. **Key Responsibilities:** - Lead the design and development of robust, scalable Python systems as the technical anchor for backend services. - Take ownership of core platform capabilities, focusing on building for reliability, performance, and operational excellence. - Champion a culture of security by design, ensuring the de...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Apache Airflow, PySpark Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code for multiple clients. Your typical day will involve collaborating wit...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : Python (Programming Language) Good to have skills : Apache Spark, Microservices and Light Weight Architecture, Apache Airflow Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code for multiple clients. Your typic...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : Snowflake Data Warehouse Good to have skills : Microsoft SQL Server, AWS Relational Database Service (RDS), Apache Airflow Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code for multiple clients. Your typical ...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : Snowflake Data Warehouse Good to have skills : Microsoft SQL Server, AWS Relational Database Service (RDS), Apache Airflow Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code for multiple clients. Your typica...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : Python (Programming Language) Good to have skills : Apache Spark, Microservices and Light Weight Architecture, Apache Airflow Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code for multiple clients. Your day w...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Apache Airflow, PySpark Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code for multiple clients. Your day will involve collaborating with team...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Apache Airflow, PySpark Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, your typical day will involve analyzing, designing, coding, and testing various components of application code for multiple clients. You will engage in maintenance and enhancement tasks, ensuring that ...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : Snowflake Data Warehouse Good to have skills : Microsoft SQL Server, AWS Relational Database Service (RDS), Apache Airflow Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code for multiple clients. Your day will...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : Python (Programming Language) Good to have skills : Apache Spark, Microservices and Light Weight Architecture, Apache Airflow Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code for multiple clients. Your typ...

You will be joining Dell Technologies as a Full Stack Data Architect & MCP Security Architect on the IT Architecture Team in Hyderabad. Your role will involve translating clients" business requirements into specific system designs, applications, and processes for customized technical solutions. You will be responsible for designing, developing, and implementing total systems solutions to meet the enterprise-wide technical requirements of customers. Additionally, you will collaborate with the IT Architecture team to ensure that the solution aligns with the needs of sales and delivery. Key Responsibilities: - Managing the design of multiple service areas or technologies within a broader servic...

You will be responsible for architecting and implementing scalable offline data pipelines for manufacturing systems, including AMHS, MES, SCADA, PLCs, vision systems, and sensor data. You will design and optimize ETL/ELT workflows using Python, Spark, SQL, and orchestration tools like Airflow to transform raw data into actionable insights. Leading database design and performance tuning across SQL and NoSQL systems will be part of your responsibilities, optimizing schema design, queries, and indexing strategies for manufacturing data. It will be essential for you to enforce robust data governance by implementing data quality checks, lineage tracking, access controls, security measures, and re...

As a Data Pipeline Developer (L1 Data Ops Analyst) at UST, your role will involve developing and maintaining data pipelines for ingesting, wrangling, transforming, and joining data from multiple sources. You will work independently to deliver high-quality code and ensure seamless operation of data systems. Proficiency in ETL tools such as Informatica, Glue, Databricks, and DataProc, along with strong coding skills in Python, PySpark, and SQL, will be essential. Operating with minimal supervision while adhering to established processes and guidelines is a key aspect of this position. **Key Responsibilities:** - Independently develop, test, and maintain data processing pipelines ensuring perfo...

As an experienced Data Engineer with 6+ years of experience, your role will involve: - Designing and implementing modern data lakehouse architectures (Delta Lake, or equivalent) on cloud platforms like AWS, Azure, or GCP. - Defining data modeling, schema evolution, partitioning, and governance strategies for high-performance and secure data access. - Owning the technical roadmap for scalable data platform solutions, aligned with enterprise needs and future growth. - Providing architectural guidance and conducting code/design reviews across data engineering teams. - Building and maintaining reliable, high-throughput data pipelines for ingestion, transformation, and integration of structured, ...

We are looking for lead or principal software engineers to join our Data Cloud team. Our Data Cloud team is responsible for the Zeta Identity Graph platform, which captures billions of behavioural, demographic, environmental, and transactional signals, for people-based marketing. As part of this team, the data engineer will be designing and growing our existing data infrastructure to democratize data access, enable complex data analyses, and automate optimization workflows for business and marketing operations. Job Description: Essential Responsibilities: As a Lead or Principal Data Engineer, your responsibilities will include: Building, refining, tuning, and maintaining our real-time and ba...

Primary Skills: Over 8 years of experience in L3 production support with deep domain expertise in Investment Management and BFSI Skilled in Python, ReactJS, Snowflake, SQL, and JavaScript, with strong proficiency in both Linux and Windows operating systems Hands-on experience with Apache Airflow for orchestrating data workflows ITIL Process: Effectively coordinate release activities across internal and external teams, ensuring seamless deployment in collaboration with Change Management Adept at troubleshooting and resolving complex issues with speed and precision Proactively engage with cross-functional teams to drive issue resolution using analytical thinking and industry best practices Acc...

Contract Duration : 4 Months (Extendable based on Performance) Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 7+ Years Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-c...

Contract Duration : 4 Months (Extendable based on Performance) Job Timings : India Evening Shift (till 11 : 30 PM IST) Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-cloud environments (AWS, Azure, ...

Contract Duration : 4 Months +Exendible based on Performance Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 4+ Years Job Description : We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment. Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow orchestration using Airflow or similar frameworks. - Design, implem...

Contract Duration : 4 Months (Extendable based on Performance) Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 7+ Years Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract. The ideal candidate will bring deep expertise in data engineering, big data platforms, and cloud-based data warehouse solutions, with the ability to work in a fast-paced remote environment. Key Responsibilities : - Lead the design, optimization, and management of large-scale data pipelines using Databricks, Spark (PySpark), and AWS data services. - Productionize and deploy Big Data platforms and applications across multi-c...

Contract Duration : 4 Months +Exendible based on Performance Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 4+ Years Job Description : We are seeking a skilled Databricks Developer to join our team on a 4-month contract basis. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced, remote environment. Key Responsibilities : - Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and AWS S3/Glue/Redshift. - Work in multi-cloud environments including AWS, Azure, and GCP. - Implement workflow orchestration using Airflow or similar frameworks. - Design, implem...