10863 Airflow Jobs - Page 45

Senior DE: Same as above but need to have experience managing data engineers, have experience working with stakeholders, actively engaging for key technical discussion and have a very good technical knowledge. Should have at least 7 years experience working in data engineering. Job responsibilities Software design, Scala and Python - Spark development experience, automated testing of new and existing components in an Agile, DevOps and dynamic environment. Minimum 1 year experience in Scala Promoting development standards, code reviews, mentoring, knowledge sharing Production support & troubleshooting. Implement the tools and processes, handling performance, scale, availability, accuracy and ...

Role Description: Sr. Data Engineer Location: Pune Mode: Hybrid Immediate Joiner/20days Job Description: Senior DE: To be successful in this role, you should meet the following requirements: Should have at least 5+ years experience working in data engineering. (Note: Must have Requirements) Scala and Python development and understanding requirements and come up solutions. Experience using scheduling tools such as Airflow. Experience with most of the following technologies (Apache Hadoop, Pyspark, Apache Spark, YARN, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services). Sound knowledge of working in Unix/Linux Platform Hands-on experience building data pipelines using Hadoop compo...

Role Description: Sr. Data Engineer Location: Pune Mode: Hybrid Immediate Joiner/20days Job Description: Senior DE: To be successful in this role, you should meet the following requirements: Should have at least 5+ years experience working in data engineering. (Note: Must have Requirements) Scala and Python development and understanding requirements and come up solutions. Experience using scheduling tools such as Airflow. Experience with most of the following technologies (Apache Hadoop, Pyspark, Apache Spark, YARN, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services). Sound knowledge of working in Unix/Linux Platform Hands-on experience building data pipelines using Hadoop compo...

Role Description: Sr. Data Engineer Location: Pune Mode: Hybrid Immediate Joiner/20days Job Description: Senior DE: To be successful in this role, you should meet the following requirements: Should have at least 5+ years experience working in data engineering. (Note: Must have Requirements) Scala and Python development and understanding requirements and come up solutions. Experience using scheduling tools such as Airflow. Experience with most of the following technologies (Apache Hadoop, Pyspark, Apache Spark, YARN, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services). Sound knowledge of working in Unix/Linux Platform Hands-on experience building data pipelines using Hadoop compo...

Role Description: Sr. Data Engineer Location: Pune Mode: Hybrid Immediate Joiner/20days Job Description: Senior DE: To be successful in this role, you should meet the following requirements: Should have at least 5+ years experience working in data engineering. (Note: Must have Requirements) Scala and Python development and understanding requirements and come up solutions. Experience using scheduling tools such as Airflow. Experience with most of the following technologies (Apache Hadoop, Pyspark, Apache Spark, YARN, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services). Sound knowledge of working in Unix/Linux Platform Hands-on experience building data pipelines using Hadoop compo...

Role Description: Sr. Data Engineer Location: Pune Mode: Hybrid Immediate Joiner/20days Job Description: Senior DE: To be successful in this role, you should meet the following requirements: Should have at least 5+ years experience working in data engineering. (Note: Must have Requirements) Scala and Python development and understanding requirements and come up solutions. Experience using scheduling tools such as Airflow. Experience with most of the following technologies (Apache Hadoop, Pyspark, Apache Spark, YARN, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services). Sound knowledge of working in Unix/Linux Platform Hands-on experience building data pipelines using Hadoop compo...

Role Description: Sr. Data Engineer Location: Pune Mode: Hybrid Immediate Joiner/20days Job Description: Senior DE: To be successful in this role, you should meet the following requirements: Should have at least 5+ years experience working in data engineering. (Note: Must have Requirements) Scala and Python development and understanding requirements and come up solutions. Experience using scheduling tools such as Airflow. Experience with most of the following technologies (Apache Hadoop, Pyspark, Apache Spark, YARN, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services). Sound knowledge of working in Unix/Linux Platform Hands-on experience building data pipelines using Hadoop compo...

Role Description: Sr. Data Engineer Location: Pune Mode: Hybrid Immediate Joiner/20days Job Description: Senior DE: To be successful in this role, you should meet the following requirements: Should have at least 5+ years experience working in data engineering. (Note: Must have Requirements) Scala and Python development and understanding requirements and come up solutions. Experience using scheduling tools such as Airflow. Experience with most of the following technologies (Apache Hadoop, Pyspark, Apache Spark, YARN, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services). Sound knowledge of working in Unix/Linux Platform Hands-on experience building data pipelines using Hadoop compo...

Role Description: Sr. Data Engineer Location: Pune Mode: Hybrid Immediate Joiner/20days Job Description: Senior DE: To be successful in this role, you should meet the following requirements: Should have at least 5+ years experience working in data engineering. (Note: Must have Requirements) Scala and Python development and understanding requirements and come up solutions. Experience using scheduling tools such as Airflow. Experience with most of the following technologies (Apache Hadoop, Pyspark, Apache Spark, YARN, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services). Sound knowledge of working in Unix/Linux Platform Hands-on experience building data pipelines using Hadoop compo...

Role Description: Sr. Data Engineer Location: Pune Mode: Hybrid Immediate Joiner/20days Job Description: Senior DE: To be successful in this role, you should meet the following requirements: Should have at least 5+ years experience working in data engineering. (Note: Must have Requirements) Scala and Python development and understanding requirements and come up solutions. Experience using scheduling tools such as Airflow. Experience with most of the following technologies (Apache Hadoop, Pyspark, Apache Spark, YARN, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services). Sound knowledge of working in Unix/Linux Platform Hands-on experience building data pipelines using Hadoop compo...

Role Description: Sr. Data Engineer Location: Pune Mode: Hybrid Immediate Joiner/20days Job Description: Senior DE: To be successful in this role, you should meet the following requirements: Should have at least 5+ years experience working in data engineering. (Note: Must have Requirements) Scala and Python development and understanding requirements and come up solutions. Experience using scheduling tools such as Airflow. Experience with most of the following technologies (Apache Hadoop, Pyspark, Apache Spark, YARN, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services). Sound knowledge of working in Unix/Linux Platform Hands-on experience building data pipelines using Hadoop compo...

Role Description: Sr. Data Engineer Location: Pune Mode: Hybrid Immediate Joiner/20days Job Description: Senior DE: To be successful in this role, you should meet the following requirements: Should have at least 5+ years experience working in data engineering. (Note: Must have Requirements) Scala and Python development and understanding requirements and come up solutions. Experience using scheduling tools such as Airflow. Experience with most of the following technologies (Apache Hadoop, Pyspark, Apache Spark, YARN, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services). Sound knowledge of working in Unix/Linux Platform Hands-on experience building data pipelines using Hadoop compo...

Role Description: Sr. Data Engineer Location: Pune Mode: Hybrid Immediate Joiner/20days Job Description: Senior DE: To be successful in this role, you should meet the following requirements: Should have at least 5+ years experience working in data engineering. (Note: Must have Requirements) Scala and Python development and understanding requirements and come up solutions. Experience using scheduling tools such as Airflow. Experience with most of the following technologies (Apache Hadoop, Pyspark, Apache Spark, YARN, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services). Sound knowledge of working in Unix/Linux Platform Hands-on experience building data pipelines using Hadoop compo...

Role Description: Sr. Data Engineer Location: Pune Mode: Hybrid Immediate Joiner/20days Job Description: Senior DE: To be successful in this role, you should meet the following requirements: Should have at least 5+ years experience working in data engineering. (Note: Must have Requirements) Scala and Python development and understanding requirements and come up solutions. Experience using scheduling tools such as Airflow. Experience with most of the following technologies (Apache Hadoop, Pyspark, Apache Spark, YARN, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services). Sound knowledge of working in Unix/Linux Platform Hands-on experience building data pipelines using Hadoop compo...

Role Description: Sr. Data Engineer Location: Pune Mode: Hybrid Immediate Joiner/20days Job Description: Senior DE: To be successful in this role, you should meet the following requirements: Should have at least 5+ years experience working in data engineering. (Note: Must have Requirements) Scala and Python development and understanding requirements and come up solutions. Experience using scheduling tools such as Airflow. Experience with most of the following technologies (Apache Hadoop, Pyspark, Apache Spark, YARN, Hive, Python, ETL frameworks, Map Reduce, SQL, RESTful services). Sound knowledge of working in Unix/Linux Platform Hands-on experience building data pipelines using Hadoop compo...

Designation: Python Developer Experienced In AI/ML Location: Turbhe, Navi Mumbai CTC: 6-12 LPA Years of Experience: 2-5 years At Arcitech.ai , we’re redefining the future with AI-powered software solutions across education, recruitment, marketplaces, and beyond. We’re looking for a Python Developer passionate about AI/ML , who’s ready to work on scalable, cloud-native platforms and help build the next generation of intelligent, LLM-driven products . 💼 Your Responsibilities AI/ML Engineering Develop, train, and optimize ML models using PyTorch/TensorFlow/Keras. Build end-to-end LLM and RAG (Retrieval-Augmented Generation) pipelines using LangChain. Collaborate with data scientists to convert ...

Overview Apply Data Warehouse and Cloud techniques to build data pipelines to provide data from different sources for our business, customer and Data Science team. This role offers many exciting challenges and opportunities: Emphasis is on managing end-to-end delivery of Data Contribute to how analytical approach is structured for specification of analysis Contribute insights from conclusions of analysis that integrate with initial hypothesis and business objective. Independently address complex problems Participate in design of analysis and modelling approach with managers and modelers This is a role that requires exceptional programming skills, proven technical leadership, ability to colla...

What can you expect? As a Data Engineer, you will be responsible for designing and implementing scalable data pipelines and AI Based solution using Databricks. You will handle end-to-end ETL/ELT processes, manage large datasets, and work with tools like Python, PySpark, and AWS S3 to ensure data is transformed and optimized for analytical use. Youll work on cutting-edge cloud and hybrid data projects, transforming raw data into meaningful insights and AI Analytics. Youll be hands-on from day one, collaborating closely with architects and business stakeholders. What is in it for you? Hybrid way of working Diversify your experience and learn new skills Opportunity to work with stakeholders glo...

Grade Level (for internal use): 12 The Role: Machine Learning Engineer - Assoc Dir The Team: You will be work closely in a world class AI ML team comprised of experts in AI ML modeling, ML & LLMOps engineers, data science and data engineering teams. You will contribute to engineering and developing solutions for ML operations and be a critical part of leading S&Ps AI-driven transformation to drive value internally and for our customers. S&P is a leader in automation and AI/ML to transform risk management. This role is a unique opportunity for ML/MLOps engineers to grow into the next step in their career journey. Responsibilities and Impact: Lead ML Engineering to architect, build and deploy ...

About ProcDNA ProcDNA is a global consulting firm. We fuse design thinking with cutting-edge technology to create game-changing Commercial Analytics and Technology solutions for our clients. We're a passionate team of 300+ across 6 offices, all growing and learning together since our launch during the pandemic. Here, you won't be stuck in a cubicle - you'll be out in the open water, shaping the future with brilliant minds. At ProcDNA, innovation isn't just encouraged; it's ingrained in our DNA. Ready to join our epic growth journey? What we are looking for Youll be driving the adoption of the latest technologies in our solutions, bringing in thought leadership to guide clients on complex dat...

About Toku At Toku, we create enterprise cloud communications and customer engagement solutions to reimagine customer experiences for enterprises. We provide an end-to-end approach to help businesses overcome the complexity of digital transformation in APAC markets and enhance their CX with mission-critical cloud communication solutions . Toku combines local strategic consulting expertise, bespoke technology, regional in-country infrastructure, connectivity and global reach to serve the diverse needs of enterprises. About The Role As Toku continues creating momentum for its products in the APAC region and helping customers with their communications needs, we are looking for an AI Engineer wi...

Who We Are: Wayfair's core platforms are increasingly driven by a cutting-edge set of data and machine learning systems that interact in complex ways to ensure that we are using our rich datasets to their full potential. Business applications of these learning systems span many fields including recommendations, marketing, supply chain optimization and merchandising. These fields require a sophisticated data technology stack that allows for complex data and machine learning systems combined with configurability for rapid testing and exploration. We are looking for a seasoned Product Manager to accelerate the development of our technology stack, leading our data platforms (specifically our Dat...

Job Purpose and Impact The Professional, Trading Engineering job maintains and partners to design and develop software applications and systems that drive the trading operations. With limited supervision, this job participates in co-creation and maintenance of sophisticated software applications vital to our trading activities, collaboration with cross functional teams to conceptualize, design and implement new software features that meet user needs and advance our business objectives, including upgrading existing software by writing clean, efficient and scalable code to improve performance and functionality, and identifying and resolving issues promptly to ensure the seamless operation of t...

Hi, Position: Python Developer Location: Hyderabad, India As a Python Developer design and build robust Python applications, emphasizing scalable, cloud-native solutions Apply .NET and general programming skills to support cross-functional projects Job requirements: We are looking to fill a programming-intensive role that focuses primarily on Python development, with secondary expertise in AWS infrastructure Leverage AWS services like Lambda, CDK, CloudFront, and Bedrock for development and deployments Optimize infrastructure with expertise in AWS deployments and networking principles Utilize tools like Airflow to streamline workflows and enhance system efficiency Proficiency in Python for a...

About The Role You will join a security initiative within Cyble, designing and implementing core backend services that ingest, process, and expose security-related data streams and APIsensuring reliability, scalability, and robust protection. What You'll Do At CYBLE Service Development o Design, build, and maintain microservices and REST/gRPC APIs using Node.js (TypeScript) or Python o Implement data ingestion pipelines from multiple external feeds and log sources o Develop processing layers for normalization, enrichment, and secure storage o Expose and document API endpoints for downstream consumers System Integration o Integrate with message queues or streaming platforms (Kafka, RabbitMQ, ...