10801 Airflow Jobs - Page 8

About the Role We are looking for a skilled DevOps Engineer with strong MLOps expertise to join our team. The ideal candidate will have hands-on experience in AWS Cloud, scripting, and automation , along with proven skills in deploying and managing machine learning pipelines in production . Key Responsibilities Design, implement, and maintain CI/CD pipelines for ML model training, testing, and deployment. Manage containerization & orchestration using Docker and Kubernetes. Automate infrastructure provisioning using Terraform/CloudFormation . Implement and manage MLOps tools (Kubeflow, MLflow, Airflow, SageMaker, etc.). Ensure scalability, reliability, and monitoring of ML/AI production syste...

Position : Data & AI Head/Lead Experience : 12-20 Years Education : B.Tech Location : Baner, Pune. Work Mode : IN Office. About Company Pratiti is looking for a leader for our Data & AI Practice to drive innovation and deliver advanced data engineering, analytics and AI/ML solutions for our global clients. Role needs a blend of hands-on expertise, solution consulting and team leadership to build Data & AI capabilities as key part of digital solutions. Key Responsibilities Work with presales and business development team during discovery phase, contribute to proposals and RFP responses. Consultative approach to advice clients on AI journey including data strategies, AI/LLM enabled use cases, ...

As a Data Engineer-II at TMRW House of Brands in Bengaluru, Karnataka, your role involves creating, implementing, and operating robust and scalable data pipelines for business intelligence and machine learning. You will be responsible for developing and maintaining core data framework and key infrastructures. Additionally, you will create and support the ETL pipeline to ensure correct data flow from existing and new sources to the data warehouse. Your responsibilities also include designing the Data Warehouse and data modeling for efficient and cost-effective reporting. Collaboration with data analysts, data scientists, and other data consumers is essential to manage the data warehouse table...

Job Overview We're looking for a proactive Sr. DevOps Consultant with min. 10 years of experience who can work for 2-3 hours/ day in IST Time zone with strong expertise in AWS and Azure to support a wide range of projects including MERN stack apps, Python/PHP services, data pipelines, and AI/ML deployments. This role will focus on infrastructure automation, secure deployments, MLOps/DataOps, monitoring, and cost optimization across all environments. The engineer will also take ad-hoc sessions with the team to review current cloud setups and ensure best practices are Responsibilities : Management : Design, implement, and manage scalable cloud infrastructure on AWS and Azure. Set up and manage...

You will play a crucial role in designing, developing, and maintaining cloud-based data infrastructure to support BFSI customers at LUMIQ. Your responsibilities will include: - Designing, developing, and implementing data pipelines, ETL processes, and data integration solutions. - Collaborating with cross-functional teams to design scalable data models and architectures aligned with BFSI industry needs. - Optimizing data storage, processing, and retrieval for maximum performance and cost-efficiency in cloud environments. - Implementing data security and compliance measures to protect sensitive BFSI data integrity. - Working closely with data scientists and analysts to enable seamless access ...

Join our digital revolution in NatWest Digital X In everything we do, we work to one aim. To make digital experiences which are effortless and secure. So we organise ourselves around three principles: engineer, protect, and operate. We engineer simple solutions, we protect our customers, and we operate smarter. Our people work differently depending on their jobs and needs. From hybrid working to flexible hours, we have plenty of options that help our people to thrive. This role is based in India and as such all normal working days must be carried out in India. Job Description Join us as a Software Engineer This is an opportunity for a technically minded individual to join us as a Software En...

As a Mid-Level Data Engineer at Thinkproject, you will be at the forefront of building, optimizing, and maintaining reliable data pipelines and workflows. Here is a glimpse of what your role entails and the qualifications required to excel in this position: Role Overview: You will play a crucial role in designing scalable data processing systems, handling both structured and unstructured data sources, and supporting data needs across the organization in a cloud-centric environment. Key Responsibilities: - Design, implement, and optimize data pipelines (batch and streaming) for efficient data ingestion, transformation, and storage. - Ensure high data integrity through monitoring, alerting, te...

As a Machine Learning Operation Engineer at Onclusive, you will be responsible for deploying, scaling, and optimizing backend algorithms, data ingestion pipelines, machine learning services, and data platforms. Your role involves applying technical knowledge and Big Data analytics on Onclusive's vast online content data to solve challenging marketing problems. ML Ops Engineers play a crucial role in the success of Onclusive. Your responsibilities will include: - Designing and building scalable machine learning services and data platforms. - Utilizing benchmarks, metrics, and monitoring to measure and improve services. - Managing systems processing tens of millions of jobs per day. - Research...

Join our digital revolution in NatWest Digital X In everything we do, we work to one aim. To make digital experiences which are effortless and secure. So we organise ourselves around three principles: engineer, protect, and operate. We engineer simple solutions, we protect our customers, and we operate smarter. Our people work differently depending on their jobs and needs. From hybrid working to flexible hours, we have plenty of options that help our people to thrive. This role is based in India and as such all normal working days must be carried out in India. Job Description Join us as a Software Engineer This is an opportunity for a technically minded individual to join us as a Software En...

Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Databricks Unified Data Analytics Platform Good to have skills : NA Minimum 3 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Summary: As an Application Developer, you will design, build, and configure applications to meet business process and application requirements. A typical day involves collaborating with team members to understand project needs, developing innovative solutions, and ensuring that applications are aligned with business objectives. You will engage in pro...

Our Company At Teradata, we believe that people thrive when empowered with better information. That’s why we built the most complete cloud analytics and data platform for AI. By delivering harmonized data, trusted AI, and faster innovation, we uplift and empower our customers—and our customers’ customers—to make better, more confident decisions. The world’s top companies across every major industry trust Teradata to improve business performance, enrich customer experiences, and fully integrate data across the enterprise. What You’ll Do Design, build, and optimize data pipelines to support AI/ML and analytics use cases across enterprise platforms (CRM, ERP, GCS, Finance). Collaborate with Dat...

Our Company At Teradata, we believe that people thrive when empowered with better information. That’s why we built the most complete cloud analytics and data platform for AI. By delivering harmonized data, trusted AI, and faster innovation, we uplift and empower our customers—and our customers’ customers—to make better, more confident decisions. The world’s top companies across every major industry trust Teradata to improve business performance, enrich customer experiences, and fully integrate data across the enterprise. What You’ll Do Design, build, and optimize data pipelines to support AI/ML and analytics use cases across enterprise platforms (CRM, ERP, GCS, Finance). Collaborate with Dat...

Our Company At Teradata, we believe that people thrive when empowered with better information. That’s why we built the most complete cloud analytics and data platform for AI. By delivering harmonized data, trusted AI, and faster innovation, we uplift and empower our customers—and our customers’ customers—to make better, more confident decisions. The world’s top companies across every major industry trust Teradata to improve business performance, enrich customer experiences, and fully integrate data across the enterprise. What You’ll Do Design, develop, and deploy AI/ML models and Generative AI solutions to enhance enterprise applications (CRM, ERP, CX, Finance). Build and integrate machine l...

Embark on a transformative journey as a Software Engineer – Integration (Linux) at Barclays, where you'll spearhead the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionize our digital offerings, ensuring unapparelled customer experiences. Operational Support Systems (OSS) Platform Engineering is a new team within the newly formed Network OSS & Tools functional unit in the Network Product domain at Barclays. The Barclays OSS Platform Engineering team is responsible for the design, build and run of the underlying OSS infrastructure and toolchain across cloud and on-prem that the core systems and tools required to run th...

Before you apply to a job, select your language preference from the options available at the top right of this page. Explore your next opportunity at a Fortune Global 500 organization. Envision innovative possibilities, experience our rewarding culture, and work with talented teams that help you become better every day. We know what it takes to lead UPS into tomorrow—people with a unique combination of skill + passion. If you have the qualities and drive to lead yourself or teams, there are roles ready to cultivate your skills and take you to the next level. Job Description Job Description We're seeking a talented Data Engineer with hands-on experience in the Google Cloud data ecosystem and ...

Before you apply to a job, select your language preference from the options available at the top right of this page. Explore your next opportunity at a Fortune Global 500 organization. Envision innovative possibilities, experience our rewarding culture, and work with talented teams that help you become better every day. We know what it takes to lead UPS into tomorrow—people with a unique combination of skill + passion. If you have the qualities and drive to lead yourself or teams, there are roles ready to cultivate your skills and take you to the next level. Job Description Job Description We're seeking a talented Data Engineer with hands-on experience in the Google Cloud data ecosystem and ...

Exp: 5 - 12 Yrs Work Mode: HybridLocation: Bangalore, Chennai, Kolkata, Pune and Gurgaon Primary Skills: Snowflake, SQL, DWH, Power BI, ETL and Informatica. We are seeking a skilled Snowflake Developer with a strong background in Data Warehousing (DWH), SQL, Informatica, Power BI, and related tools to join our Data Engineering team. The ideal candidate will have 5+ years of experience in designing, developing, and maintaining data pipelines, integrating data across multiple platforms, and optimizing large-scale data architectures. This is an exciting opportunity to work with cutting-edge technologies in a collaborative environment and help build scalable, high-performance data solutions. Key...

Avant de postuler à un emploi, sélectionnez votre langue de préférence parmi les options disponibles en haut à droite de cette page. Découvrez votre prochaine opportunité au sein d'une organisation qui compte parmi les 500 plus importantes entreprises mondiales. Envisagez des opportunités innovantes, découvrez notre culture enrichissante et travaillez avec des équipes talentueuses qui vous poussent à vous développer chaque jour. Nous savons ce qu’il faut faire pour diriger UPS vers l'avenir : des personnes passionnées dotées d’une combinaison unique de compétences. Si vous avez les qualités, de la motivation, de l'autonomie ou le leadership pour diriger des équipes, il existe des postes adap...

Key Responsibilities End-to-End Product Ownership: Lead the development of predictive models from exploration and prototype to full-scale production deployment. Prediction: Build robust regression and/or time-series and/or deep learning models to predict prices/values of financial assets, oil, apparel, and other commodities. Model Optimization: Continuously monitor and fine-tune models for accuracy, performance, and scalability using real-time data feedback. ML Ops & Deployment: Collaborate with engineering to ensure successful deployment and monitoring of models in production environments. Stakeholder Collaboration: Translate business problems into analytical frameworks, working closely wit...

Req ID: 341155 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AWS Sr Data Engineer to join our team in Bangalore or Remote, Karn?taka (IN-KA), India (IN). Position Location: OUS with minimum of 6 hrs. overlap with US timings. Project Overview (If Possible): It's one of the workstreams of Project Acuity. PASD Data Platform includes centralized web application for internal PASD users across the Recruitment Business to support marketing and operational use cases. Building a database at the patient level will provide si...

Role Overview: We're looking for someone with 5+ years of experience in data engineering, analytics, and ML-based solutions. Job Responsibilities Design and manage scalable ETL/ELT pipelines using AWS Glue, Redshift, S3, and Kafka/Kinesis. Architect and implement data lake and warehouse solutions following best practices. Build and deploy ML models for classification, prediction, and anomaly detection. Automate workflows and orchestration with Airflow or Step Functions. Enable self-service analytics through tools like ThoughtSpot and QuickSight Q. Ensure data integrity, security, governance, and compliance. Mentor and support junior engineers to build a high-performing team. Qualifications 5...

Responsibilities: Lead the design and development of scalable data pipelines using AWS (Glue, Redshift, Athena) Drive architecture decisions for data systems that support business analytics and application features Build end-to-end solutions, including backend APIs and, where applicable, simple UI components Orchestrate workflows using Airflow or equivalent tools, ensuring dependency management and error handling Ensure high standards of data quality through validation frameworks and monitoring Automate deployment and testing processes through CI/CD for data infrastructure Partner with cross-functional teams to understand data needs and deliver reliable, performant solutions Mentor junior en...

As a member of this team, the data engineer will be responsible for designing and expanding our existing data infrastructure, enabling easy access to data, supporting complex data analyses, and automating optimization workflows for business and marketing operations Essential Responsibilities: As a Senior Software Engineer, your responsibilities will include: Building, refining, tuning, and maintaining our real-time and batch data infrastructure Daily use technologies such as Python, Spark, Airflow, Snowflake, Hive, FastAPI, etc. Maintaining data quality and accuracy across production data systems Working with Data Analysts to develop ETL processes for analysis and reporting Working with Prod...

Essential Responsibilities: As a Senior Software Engineer, your responsibilities will include: Building, refining, tuning, and maintaining our real-time and batch data infrastructure Daily use technologies such as Python, Spark, Airflow, Snowflake, Hive, FastAPI, etc. Maintaining data quality and accuracy across production data systems Working with Data Analysts to develop ETL processes for analysis and reporting Working with Product Managers to design and build data products Working with our DevOps team to scale and optimize our data infrastructure Participate in architecture discussions, influence the road map, take ownership and responsibility over new projects Participating in on-call ro...

Essential Responsibilities: As a Senior Software Engineer, your responsibilities will include: Building, refining, tuning, and maintaining our real-time and batch data infrastructure Daily use technologies such as Python, Spark, Airflow, Snowflake, Hive, FastAPI, etc. Maintaining data quality and accuracy across production data systems Working with Data Analysts to develop ETL processes for analysis and reporting Working with Product Managers to design and build data products Working with our DevOps team to scale and optimize our data infrastructure Participate in architecture discussions, influence the road map, take ownership and responsibility over new projects Participating in on-call ro...