10863 Airflow Jobs - Page 17

As a Data Engineer with 3-5 years of experience, your role will involve implementing scalable and sustainable data engineering solutions using tools like Databricks, Snowflake, Teradata, Apache Spark, and Python. You will be responsible for creating, maintaining, and optimizing data pipelines as workloads transition from development to production for specific use cases. Your ownership will extend to end-to-end development tasks, including coding, testing, debugging, and deployment. Your key responsibilities will include: - Driving automation through the use of modern tools and techniques to automate repeatable data preparation and integration tasks, thereby enhancing productivity. - Mapping ...

Company Description BEYOND SOFTWARES AND CONSULTANCY SERVICES Pvt. Ltd. (BSC Services) is committed to delivering innovative solutions to meet clients' evolving needs, particularly in the telecommunication industry. We provide a variety of software solutions for billing and customer management, network optimization, and data analytics. Our skilled team of software developers and telecom specialists collaborates closely with clients to understand their specific requirements and deliver high-quality, secure software solutions. We strive to build long-term relationships based on trust, transparency, and open communication, ensuring our clients stay competitive and grow in a dynamic market. Role...

As an AI/ML Engineer at Automation Anywhere, you will be part of the Cloud Operations (CloudOps) team, responsible for designing, developing, and deploying AI/ML models and automation solutions to optimize cloud infrastructure management and operational efficiency. **Primary Responsibilities:** - Design, develop, and deploy machine learning models and AI algorithms for automating cloud infrastructure tasks like monitoring, fault detection, and predictive maintenance. - Collaborate with Cloud Engineers, ML Engineers, Data Scientists, and DevOps teams to integrate AI/ML solutions into cloud orchestration and management platforms. - Build scalable data pipelines and workflows using cloud-native...

IMEA (India, Middle East, Africa) India LIXIL INDIA PVT LTD Employee Assignment Fully remote possible Full Time 1 May 2025 Title Data Engineer Job Description A Data Engineer is responsible for designing, building, and maintaining large-scale data systems and infrastructure. Their primary goal is to ensure that data is properly collected, stored, processed, and retrieved to support business intelligence, analytics, and data-driven decision-making. Key Responsibilities Design and Develop Data Pipelines: Create data pipelines to extract data from various sources, transform it into a standardized format, and load it into a centralized data repository. Build and Maintain Data Infrastructure: Des...

As an experienced Data Scientist, your role will involve the following responsibilities: - Lead the development of predictive models from exploration to full-scale production deployment, taking ownership of the entire product lifecycle. - Build robust regression, time-series, and deep learning models to predict prices/values of financial assets, oil, apparel, and other commodities. - Continuously monitor and fine-tune models for accuracy, performance, and scalability using real-time data feedback for model optimization. - Collaborate with engineering teams to ensure successful deployment and monitoring of models in production environments as part of ML Ops & Deployment. - Work closely with p...

As a Data Platform Support Engineer at McDonalds, your role will involve designing, implementing, and maintaining scalable and secure platform services to facilitate efficient data transfers, API integrations, and platform operations across the enterprise. Your responsibilities will include: - Designing, implementing, and maintaining secure and efficient platform solutions to support APIs, data transfers, and analytics workflows. - Monitoring platform health, optimizing for performance and uptime, and implementing diagnostic and observability practices. - Providing Level 2/3 technical support for platform services to minimize disruption and accelerate issue resolution. - Supporting platform ...

Role Overview: As a Software Engineer III at JPMorgan Chase within the Corporate Technology, you will be a seasoned member of an agile team responsible for designing and delivering trusted market-leading technology products in a secure, stable, and scalable manner. Your role involves executing software solutions, development, and technical troubleshooting while maintaining high-quality production code and algorithms. You will contribute to the architecture and design of complex applications, ensuring design constraints are met by software code development. Additionally, you will analyze and synthesize data sets to drive continuous improvement of software applications and systems. Your proact...

As an experienced AI Architect with more than 10 years of expertise in Artificial Intelligence, Machine Learning, and Data Science, you will play a pivotal role in defining and leading our AI strategy. Your primary responsibility will be to design and optimize AI/ML solutions from data ingestion to production. Additionally, you will build advanced ML, deep learning, and generative AI models, work with large datasets, pipelines, and automation, and deploy and maintain AI systems in production while ensuring scalability, reliability, and monitoring. Implementing MLOps practices such as CI/CD for ML, containerization, and orchestration will also be part of your key responsibilities. Apply your ...

Technology Lead ETL & Data Engineering (Fandango) Location: Pune / Hybrid Experience: 8 to 12 Years Employment Type: Full-Time Job Summary We are seeking a highly skilled and experienced Technology Lead with 10+ years of expertise in ETL, Data Warehousing, and AWS cloud services. The ideal candidate should have strong hands-on experience with Talend (Data Integration, Big Data, Admin), AWS Glue, PySpark, Airflow (MWAA preferred), and AWS Redshift. You will play a critical role in designing, developing, and leading data integration pipelines, ensuring scalability, performance, and business impact. Key Responsibilities Lead the design, development, and deployment of end-to-end ETL and Data War...

Join our digital revolution in NatWest Digital X In everything we do, we work to one aim. To make digital experiences which are effortless and secure. So we organise ourselves around three principles: engineer, protect, and operate. We engineer simple solutions, we protect our customers, and we operate smarter. Our people work differently depending on their jobs and needs. From hybrid working to flexible hours, we have plenty of options that help our people to thrive. This role is based in India and as such all normal working days must be carried out in India. Job Description Join us as a Software Engineer This is an opportunity for a driven Software Engineer to take on an exciting new caree...

We’re looking for a hands-on Security Engineer with expertise in AI/ML, automation, and workflow orchestration to help us build secure automations and intelligent workflows across our security and compliance platforms. What you’ll do: Build & secure workflows with Zapier, n8n, Make.com, Airflow, and other automations tools and models. Understanding of all different LLM models and flows. Develop AI/ML-driven security automations (threat detection, anomaly scoring, auto-remediation) Integrate tools like AWS, Jira, GitHub, SIEM/SOAR platforms into automated pipelines Strong in AI/ML (Python, LLMs, anomaly detection models) Skilled with automation tools & APIs (Zapier, n8n, webhooks, scripting,)...

As an experienced data engineer, your role will involve enabling data frameworks to automate domain-specific data and analytics workflows. You will be responsible for incorporating GenAI into data engineering workflows, applications, or internal data and analytics tools. Additionally, optimizing ETL workflows to enhance data processing efficiency and reliability will be a key part of your responsibilities. Ensuring data integrity and performance in big data workflows and building frameworks to automate test suites and streamline data operations will also be crucial tasks. You will be developing and deploying AI-powered support tools for developers, such as code suggestion bots, to help ident...

Join us as a Software Engineer This is an opportunity for a driven Software Engineer to take on an exciting new career challenge Day-to-day, you'll build a wide network of stakeholders of varying levels of seniority It’s a chance to hone your existing technical skills and advance your career We're offering this role at associate level What you'll do In your new role, you’ll engineer and maintain innovative, customer centric, high performance, secure and robust solutions. You’ll be working within a feature team and using your extensive experience to engineer software, scripts and tools that are often complex, as well as liaising with other engineers, architects and business analysts across th...

Join us as a Software Engineer This is an opportunity for a driven Software Engineer to take on an exciting new career challenge Day-to-day, you'll build a wide network of stakeholders of varying levels of seniority It’s a chance to hone your existing technical skills and advance your career We're offering this role at associate level What you'll do In your new role, you’ll engineer and maintain innovative, customer centric, high performance, secure and robust solutions. You’ll be working within a feature team and using your extensive experience to engineer software, scripts and tools that are often complex, as well as liaising with other engineers, architects and business analysts across th...

AI Intern Company Description Launched in 2007 by Aloke Bajpai & Rajnish Kumar, ixigo is a technology company focused on empowering Indian travelers to plan, book and manage their trips across rail, air, buses and hotels. ixigo assists travelers in making smarter travel decisions by leveraging artificial intelligence, machine learning and data science-led innovations on ixigos OTA platforms, including websites and mobile applications. ConfirmTkt and AbhiBus became a part of ixigo in 2021. ixigo is headquartered in Gurugram with offices in Bangalore (ConfirmTkt) and Hyderabad (AbhiBus). Abhibus Services (India) Private Limited is a pioneer in providing end-to-end software and other value adde...

Job Description Some careers shine brighter than others. If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions. We are currently seeking an experienced professional to...

Job Description Some careers shine brighter than others. If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions. We are currently seeking an experienced professional to...

Maersk, the world’s largest integrated logistics company, is transforming how goods move across continents - and at the heart of that shift is data infrastructure . We are building MIDAS , a modern, federated, metadata-driven data platform engineered for composability, governance, and AI-readiness. We are hiring a Senior Engineering Manager to lead platform engineering efforts for MIDAS - designing and scaling a multi-tenant, real-time, contract-first data platform that spans hundreds of internal systems and supports critical customer and operational use cases. This is not just a leadership role. It’s a once-in-a-decade opportunity to build the foundational data and AI architecture for an en...

About The Company Sigmoid is a leading data solutions company that partners with Fortune 500 enterprises to drive digital transformation through AI, big data, and cloud technologies. With a focus on scalability, performance, and innovation, Sigmoid delivers cutting-edge solutions to solve complex business challenges. About The Role You will be responsible for building a highly scalable, extensible, and robust application. This position reports to the Engineering Manager. Responsibilities Align Sigmoid with key Client initiatives Interface daily with customers across leading Fortune 500 companies to understand strategic requirements Ability to understand business requirements and tie them to ...

Lead Data Engineer Primary Skills DataStream, ETL Fundamentals, SQL, SQL (Basic + Advanced), Python, Data Warehousing, Time Travel and Fail Safe, Snowpipe, SnowSQL, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures Job requirements Job Summary: We are seeking a skilled and detail-oriented Platform Administrator to manage and support our Snowflake data platform and Tableau analytics environment. The ideal candidate will have hands-on experience in platform administration, performance tuning, user and role management, and ensuring security and operational efficiency across both platforms. Key Responsibilities: Snowflake Administration: Manage Snowf...

About Netsmart At Netsmart, we’re transforming healthcare through intelligent, scalable, and human-centered technology. Our Hebbal office is a hub of innovation, where talented engineers, designers, and product thinkers collaborate to solve real-world challenges with global impact. We foster a culture of curiosity, continuous learning, and experimentation. If you're passionate about building technology that makes a difference, you'll thrive here. Your Role Netsmart is seeking a skilled and motivated MLOps Engineer to join our team in driving the operationalization of machine learning models that transform healthcare. In this role, you will be responsible for designing, implementing, and main...

Immediate Joiner/15-30 days notice period SRE+ Python(5+ years) In this role, you will play a crucial part in shaping the firm's infrastructure reliability and efficiency by implementing robust Site Reliability Engineering practices.

1.Data Pipeline Devlopment and maintainance 2.Database and Data Warehouse Management 3.data Transformation and Integration https://docs.google.com/spreadsheets/d/1dTIagGAwtsK_iZwlVS1fN3d_ZXfYqyFgjuOba1hhUtc/edit?gid=1273277659#gid=1273277659 Required Candidate profile https://docs.google.com/spreadsheets/d/1dTIagGAwtsK_iZwlVS1fN3d_ZXfYqyFgjuOba1hhUtc/edit?gid=1273277659#gid=1273277659

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Job Description Location: Hyderabad, Noida, Gurugram About The Role We are seeking a highly experienced and passionate Data Engineer to join our growing data team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining our robust data infrastructure, ensuring data quality, availability, and scalability. You will play a critical role in empowering our data-driven decision-making by building and optimizing data pipelines, ETL processes, and data warehousing solutions. This is a senior-level position requiring extensive experience with database technologies, data modelling, and cloud platforms. Responsibilities Data Pipeline Development & Maintenance: Desi...