10863 Airflow Jobs - Page 13

Job Summary We are looking for a skilled and motivated Data Scientist to join our team as an individual contributor . The ideal candidate should have at least two years of experience in data science or ML engineering, with hands-on expertise in Databricks , PySpark , and SQL . You’ll be responsible for owning and delivering scalable machine learning solutions end-to-end—from exploration to production—working independently and collaborating closely with business and engineering teams. Key Responsibilities Own and deliver the complete lifecycle of machine learning projects, from data exploration and feature engineering to model deployment and monitoring. Develop, optimize, and maintain ML and ...

Analysis and problem-solving capabilities. • Degree in Maths/Physics/Statistics/similar discipline or previous experience of a similar role. • Ability to interpret data, recognize problems as they arise, suggest and implement appropriate actions. • Ability to communicate clearly, both verbally and via detailed specifications and reports. • Excellent organizational skills and capability of working to tight deadlines. • Ability to work to a high level of accuracy. • Experience in testing applications using Python and Pyspark in a Hadoop environment with HDFS. • Experience in AWS services S3, Lambdas, Managed Airflow (MWAA), and EMR Serverless. • Familiarity with agile ways of working and data ...

We're hiring a Software Engineer to join our growing team. You'll be part of a young, ambitious, and collaborative engineering culture. We ship new features weekly, work across exciting technologies, and constantly push ourselves to build products that are efficient, scalable, and impactful. If you're eager to learn, grow, and make real contributions from day one, this is the place for you. Responsibilities Build and maintain applications using Node.js, Golang, Java, and other modern technologies. Create and manage data pipelines with ETL tools (e. g., Apache Airflow), connecting to MongoDB and SQL databases. Work with Kafka or similar message queues for real-time data. Partner with DevOps t...

We're hiring a Senior Software Engineer to take ownership of key systems and guide our engineering growth. You'll play a crucial role in designing, scaling, and optimizing our systems while mentoring teammates and shaping our engineering culture. This is your chance to work across exciting technologies, drive impact, and help us ship smarter and faster. Responsibilities Architect, build, and maintain applications using Node.js, Golang, Java, and other modern technologies. Design and manage data pipelines with ETL tools (e. g., Apache Airflow), connecting to MongoDB and SQL databases. Own and optimize Kafka or similar message queue systems for real-time data. Partner with DevOps to manage Kub...

We're hiring a Software Engineer at Refold.ai . This is a rare opportunity to build and scale cutting-edge AI-first products. You'll work closely with a talented team to design, develop, and ship features that power our growth. This role sits at the intersection of software engineering, data engineering, and AI, requiring someone who can think critically while executing with excellence. Responsibilities Build and maintain applications using Node.js, Golang, Java, and other technologies. Design and manage data pipelines with ETL tools (e. g., Apache Airflow), integrating MongoDB and SQL databases. Implement real-time systems using Kafka or similar messaging queues. Collaborate with AI enginee...

We are seeking a Data Engineer to design and maintain scalable data pipelines that power finance-related analytics and reporting. This role involves partnering closely with finance, product, and business teams to translate requirements into robust technical solutions while ensuring data accuracy, consistency, and performance. You will work with modern data technologies, including SQL, Python, Spark, Airflow, and AWS cloud services to build efficient workflows, optimize large-scale datasets, and deliver business-critical insights. Responsibilities Design, build, and maintain scalable data pipelines for finance-related datasets. Partner with finance stakeholders (product and business teams) to...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and data tra...

Sia is a next-generation, global management consulting group. Founded in 1999, we were born digital. Today our strategy and management capabilities are augmented by data science, enhanced by creativity and driven by responsibility. We’re optimists for change and we help clients initiate, navigate and benefit from transformation. We believe optimism is a force multiplier, helping clients to mitigate downside and maximize opportunity. With expertise across a broad range of sectors and services, our 3,000 consultants serve clients worldwide from 48 locations in 19 countries. Our expertise delivers results. Our optimism transforms outcomes. Strategy & Management Consulting Sia’s Strategy & Manag...

Hi, Greetings from the IDES LABS, Job Posting Title: Senior Platform Engineer Description: Bachelors degree (Computer Science), masters degree or Technical Diploma or equivalent At least 8 years of experience in a similar role At least 5 years of experience on AWS and/or Azure At least 5 years of experience on Databricks At least 5 years of experience on multiples Azure and AWS PaaS solutions: Azure Data Factory, MSSQL, Azure storage, AWS S3, Cognitive search, CosmosDB, Event Hub, AWS glue Strong knowledge of AWS and Azure architecture design best practices Knowledge of ITIL & AGILE methodologies (certifications are a plus) Experience working with DevOps tools such as Git, CI/CD pipelines, A...

About Us: Atica is a leading, tech-first remote sales & revenue management company for Hotels and Hotel operators in the US, enabled by a unified tech-led solution. We are a startup, funded by the top investors in the country, like Titan Capital, DIBS. As innovators at the forefront of the industry, we strive to deliver the highest quality service to all our clients while setting new standards for efficiency and effectiveness. We aspire to build high-quality, innovative & robust software that makes an impact! We are seeking a passionate and talented Data Engineer - II to join our dynamic team. Find more about us! https://www.aticaglobal.com https://www.linkedin.com/company/atica-global Time:...

We're Hiring: Data Engineer – Platform & Distributed Systems Are you a builder at heart who loves working at the intersection of data engineering, cloud infrastructure, and ML platforms? We’re looking for a Data Engineer to join our team and help scale our JupyterLab-based Notebook platform, enabling data scientists and engineers across cloud and on-premise environments. This role is ideal for someone who’s passionate about developing powerful tools, enabling distributed processing, and ensuring secure, scalable infrastructure for advanced analytics and machine learning. 🔧 What You’ll Work On: Enhance and maintain our custom Notebook platform (JupyterLab) for data science and ML workflows. I...

Job Description Role: Enterprise Architect Who are we looking for? As a Senior Data Architect in the BFSI domain, you will be responsible for designing and governing data architecture across core banking, Wealth Management and financial platforms. You’ll lead initiatives that span legacy systems (mainframes) to modern cloud-native and NoSQL solutions, ensuring regulatory compliance, data lineage, and high availability for mission-critical applications. Domain Expertise: Deep understanding of BFSI data domains : customer, account, transaction, trading, portfolios, positions, credit, risk, claims, policy, and underwriting. Experience with financial data modeling , including ledger structures ,...

Job Description Data Engineer The ideal candidate must possess strong communication and collaboration skills, with the ability to design and build robust data architectures. They should demonstrate ownership in delivering scalable data solutions, working across technical and business teams to support analytics and BI requirements. The candidate should be proactive in identifying issues in data quality and have a strong sense of responsibility towards governance and compliance. Role and Responsibilities: Design, build, and maintain scalable and efficient data pipelines for ingesting and transforming data from multiple sources. Develop and manage cloud-based data lakes optimized for analytics ...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Apache Airflow, PySpark Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, your typical day will involve analyzing, designing, coding, and testing various components of application code for multiple clients. You will engage in maintenance and enhancement tasks, ensuring that ...

KITCO is a multi-disciplinary Engineering, Management and Technical consulting firm that brings innovative solutions to the challenges faced by your business. A strong planning and engineering department enables KITCO to offer consultancy service under one roof from concept to commissioning. Key Responsibilities · Designing and selecting HVAC systems, including chillers, air handling units (AHUs), ductwork, and ventilation. · Performing heat load calculations, airflow analysis, and system sizing. · Ensuring energy efficiency and compliance with ASHRAE, SMACNA, and local building codes. · Designing water supply, drainage, and sanitary systems. · Planning and implementing fire suppression syst...

Educational Requirements Bachelor of Engineering,Bachelor Of Technology Service Line Cloud & Infrastructure Services Responsibilities A day in the life of an Infoscion As part of the Infosys delivery team, your primary role would be to ensure effective Design, Development, Validation and Support activities, to assure that our clients are satisfied with the high levels of service in the technology domain. You will gather the requirements and specifications to understand the client requirements in a detailed manner and translate the same into system requirements. You will play a key role in the overall estimation of work requirements to provide the right information on project estimations to T...

Job description: TEKNA manufacturing is a progressive fast growing medical device manufacturing company having their facilities in Florida, USA and Chennai, India. TEKNA products are US FDA cleared, and our facilities are ISO's 9001-2015, 13485-2016, ASME and "U" stamp certified. We are multinational company having operation worldwide. For more information please visit https://hyperbaric-chamber.com/ EXEPRIENCE:- 2 TO 5 Years JOB DESCRIPTION:- . Install and maintain HVAC systems that support the operation and integrity of controlled environments. · Work closely with engineers and production teams to ensure HVAC systems meet strict specifications for pressure, humidity, and temperature contro...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : GCP Dataflow, Spring Boot, Apache Kafka, Apache Airflow Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing application features, and ensuring that the applications are optimized for performanc...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : Google BigQuery Good to have skills : NA Minimum 12 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, facilitating discussions to address challenges, and guiding the team in implementing effective solutions. You will als...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : Snowflake Data Warehouse Good to have skills : Microsoft SQL Server, AWS Relational Database Service (RDS), Apache Airflow Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code for multiple clients. Your typica...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : GCP Dataflow, Spring Boot, Apache Kafka, Apache Airflow Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing application features, and ensuring that the applications are aligned with business ob...

Experience: 3+ Years Job Type: Full Time Location: Ahmedabad Requirements Strong proficiency in Python (pandas, PySpark, or similar frameworks). Solid knowledge of SQL (query optimization, joins, indexing, performance tuning). Experience with ETL frameworks/workflow orchestration (Airflow, or custom pipelines). Hands-on with cloud platforms (AWS S3, Redshift, Glue, GCP BigQuery, Azure Data Factory). Knowledge of data warehousing concepts and schema design (Star/Snowflake). Familiarity with file formats such as JSON, Parquet, Avro. Exposure to big data ecosystems (Hadoop, Spark, Hive, Kafka) is a plus. Experience with containerization and orchestration (Docker, Kubernetes). Familiarity with C...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Azure Databricks Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data qualit...

About The Role Project Role : Software Development Engineer Project Role Description : Analyze, design, code and test multiple components of application code across one or more clients. Perform maintenance, enhancements and/or development work. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : Apache Airflow, PySpark Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Software Development Engineer, you will engage in a dynamic work environment where you will analyze, design, code, and test various components of application code for multiple clients. Your day will involve collaborating with team...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : GCP Dataflow, Spring Boot, Apache Kafka, Apache Airflow Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing application features, and ensuring that the applications are aligned with business ob...