15216 Airflow Jobs - Page 5

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Lead Data Engineer (Snowflake/DBT) in India. In this role, you will lead the design, development, and optimization of data pipelines, warehouses, and analytics platforms to enable data-driven decisions across multiple business functions. You will work with cross-functional teams to translate complex business requirements into scalable, efficient data solutions, leveraging modern tools like Snowflake, DBT, Airflow, and Looker. This position offers the opportunity to mentor junior engineers, implement best practices in data governance, and ensure data quality, reliability, and performance. You w...

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Data Operations Engineer 2 in India. In this role, you will design, build, and maintain robust, scalable data pipelines and infrastructure to support analytics and business operations in a fast-paced healthcare technology environment. You will work closely with data scientists, analysts, and engineering teams to ensure data is accurate, accessible, and optimized for reporting and operational use. This position provides the opportunity to work with modern cloud technologies, ETL frameworks, and streaming platforms, while contributing to the continuous improvement of data architecture and operat...

Company Description 👋🏼 We're Nagarro. We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale across all devices and digital mediums, and our people exist everywhere in the world (17500+ experts across 39 countries, to be exact). Our work culture is dynamic and non-hierarchical. We are looking for great new colleagues. That's where you come in! Job Description Requirement: 7.5+ years of total experience in data operations, ETL development, and technical solutioning. Proven experience in leading large-scale data initiatives and RFP responses. Strong hands-on experience with ETL ...

About The Job We are seeking a DevOps Engineer to design, implement, and manage scalable cloud infrastructure and CI/CD pipelines for Data and Machine Learning platforms. The ideal candidate will have good experience with AWS Cloud, Terraform, and automation frameworks supporting end-to-end ML lifecycle operations. Key Responsibilities Design and implementation of DevOps solutions for Data and ML workloads. Build and maintain CI/CD pipelines for data ingestion, model training, and deployment. Manage and optimize AWS cloud infrastructure ensuring scalability, security, and cost efficiency. Automate infrastructure provisioning and configuration using Terraform or similar IaC tools. Collaborate...

Description About Norstella At Norstella, our mission is simple: to help our clients bring life-saving therapies to market quicker—and help patients in need. Founded in 2022, but with history going back to 1939, Norstella unites best-in-class brands to help clients navigate the complexities at each step of the drug development life cycle —and get the right treatments to the right patients at the right time. Each Organization (Citeline, Evaluate, MMIT, Panalgo, The Dedham Group) Delivers Must-have Answers For Critical Strategic And Commercial Decision-making. Together, Via Our Market-leading Brands, We Help Our Clients Citeline – accelerate the drug development cycle Evaluate – bring the righ...

Role Overview: As a Data Engineer at our company, you will be responsible for developing, optimizing, and managing robust ETL pipelines to handle large-scale data processing and transformation. You will be working on building and maintaining data lake architectures on AWS S3 and data warehouse solutions on Redshift for efficient storage and retrieval. Additionally, you will use Databricks for advanced data processing, pipeline orchestration, and integration with downstream AI/ML systems. Your role will also involve leveraging various AWS services for scalable, production-grade data solutions and developing data processing logic in Python, PySpark, SQL, and other programming languages. Key Re...

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. AI Automation Architect for Customer Business Process – Manager The opportunity We’re looking for Manager Level Architects with expertise in Generative AI who can work on end-to-end pipelines, enabling data curation, building and fine-tuning Generative AI models, and deploying them into scalable production streams. Analytics, AI innovation, a...

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. AI Automation Architect for Customer Business Process – Manager The opportunity We’re looking for Manager Level Architects with expertise in Generative AI who can work on end-to-end pipelines, enabling data curation, building and fine-tuning Generative AI models, and deploying them into scalable production streams. Analytics, AI innovation, a...

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. AI Automation Architect for Customer Business Process – Manager The opportunity We’re looking for Manager Level Architects with expertise in Generative AI who can work on end-to-end pipelines, enabling data curation, building and fine-tuning Generative AI models, and deploying them into scalable production streams. Analytics, AI innovation, a...

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. AI Automation Architect for Customer Business Process – Manager The opportunity We’re looking for Manager Level Architects with expertise in Generative AI who can work on end-to-end pipelines, enabling data curation, building and fine-tuning Generative AI models, and deploying them into scalable production streams. Analytics, AI innovation, a...

Join our dynamic and high-impact Data team as a Data Engineer, where you'll be responsible for safely receiving and storing trading-related data for the India teams, as well as operating and improving our shared data access and data processing systems. This is a critical role in the organisation as the data platform drives a huge range of trader analysis, simulation, reporting and insights. The ideal candidate should have work experience in systems engineering, preferably with prior exposure to financial markets and with proven working knowledge in the fields of Linux administration, orchestration and automation tools, systems hardware architecture as well as storage and data protection tech...

Responsibilities: Only 8+ allowed Design, develop & maintain ETL processes using AWS Glue, lambda, Python & SQL Optimize performance with Airflow workflows or Step Functions Sound knowledge on Python, spark & optimisation techniques Knowledge of Redshift Office cab/shuttle

🚀 We are Hiring – Python Lead Developer (Hybrid – Chennai) A leading technology-driven organization is seeking an experienced Python Lead Developer to join their team on a contract role. This position requires strong leadership abilities along with deep expertise in Python, SQL, AWS Cloud, and Apache Airflow. 📌 Position Overview Role: Python Lead Developer Location: Chennai – Hybrid (3 days onsite per week) Experience: 8–10 Years Bill Rate: ₹150,000 per month (Contract) Employment Type: Contract 🛠 Key Responsibilities Lead and mentor a team of Python developers to deliver scalable, high-quality software solutions. Architect, design, and develop backend services and data pipelines using Pytho...

Exp in Python or Scala, Databricks and Apache Spark SQL and data warehousing concepts, AWS, Azure, GCP Exposure to CI/CD practices Understanding of data modeling ETL data from various sources(structured and unstructured) into the Databricks platform.

Role: Data Engineering Remote Looking for 5-10 years of Exp • Design, develop & maintain ETL/ELT pipelines • Ingest & transform data from APIs, DBs, files, streams • Build real-time & batch processing solutions • Data validation, quality & cleansing • Translate business needs into data models • Ensure data security, access control & compliance • Maintain documentation & best practices Snowflake, AWS/GCP/Azure, Databricks (Lakehouse + Spark), BigQuery (Google Cloud), Azure Synapse / AWS Redshift, Kafka, Azure Data Factory, AWS Glue, Apache Spark, Apache Hadoop, Airflow, dbt, PySpark, SQL, Real-time & Batch Pipelines, Data Quality & Governance, Informatica, Talend, Collibra.

You are passionate about quality and how customers experience the products you test. You have the ability to create, maintain and execute test plans in order to verify requirements. As a Quality Engineer at Equifax, you will be a catalyst in both the development and the testing of high priority initiatives. You will develop and test new products to support technology operations while maintaining exemplary standards. As a collaborative member of the team, you will deliver QA services (code quality, testing services, performance engineering, development collaboration and continuous integration). You will conduct quality control tests in order to ensure full compliance with specified standards ...

About the Role As a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics. Responsibilities Develop and maintain scalable ETL/ELT pipelines using Python, Airflow, and dbt Build and optimize real-time streaming pipelines using Kafka, RabbitMQ, Spark and event-driven microservices Leverage AI coding agents (Claude Code, Cursor AI, GitHub Copilot) to accelerate data pipeline development, data transformation, and optimization Design and manage data storage solutions with PostgreSQL, ClickHouse and Elasticsearch Define and implement data modeling best practices for efficient and scalable data storage. Ensure high av...

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. How will you make an impact in this role There are hundreds of opportunities to make your mark on technology and life at American Express. Here's just some of what...

Job Title: Lead Data Engineer Wealth Management Location: [Noida/Gurgaon/Remote] Experience: 10+ years Must Have: Wealth Management Domain, Fabric, Data Lake, Python Job Summary: We are seeking a highly skilled Lead Data Engineer (Azure) with deep expertise in the Wealth Management domain to design, implement, and manage scalable data solutions. Experience in building end-to-end Data Lake and Modern Data Platform programs covering the full lifecycle from data ingestion (Bronze Layer) to curation and transformation (Silver Layer), and finally business-ready consumption (Gold Layer) for analytics, AI, and reporting. Work spans across greenfield builds, modernization, re-platforming, and AI/Gen...

We have developed API gateway aggregators using frameworks like Hystrix and spring-cloud-gateway for circuit breaking and parallel processing. Our serving microservices handle more than 15K RPS on normal days and during saledays this can go to 30K RPS. Being a consumer app, these systems have SLAs of ~10ms Our distributed scheduler tracks more than 50 million shipments periodically fromdifferent partners and does async processing involving RDBMS. We use an in-house video streaming platform to support a wide variety of devices and networks. What Youll Do Design and implement scalable and fault-tolerant data pipelines (batch and streaming) using frameworks like Apache Spark , Flink , and Kafka...

About the Opportunity Job TypeApplication 31 July 2025 TitlePrincipal Data Engineer (Associate Director) DepartmentISS LocationBangalore Reports ToHead of Data Platform - ISS Grade 7 Department Description ISS Data Engineering Chapter is an engineering group comprised of three sub-chapters - Data Engineers, Data Platform and Data Visualisation that supports the ISS Department. Fidelity is embarking on several strategic programmes of work that will create a data platform to support the next evolutionary stage of our Investment Process.These programmes span across asset classes and include Portfolio and Risk Management, Fundamental and Quantitative Research and Trading. Purpose of your role Th...

Essential Responsibilities: As a Senior Software Engineer, your responsibilities will include: Building, refining, tuning, and maintaining our real-time and batch data infrastructure Daily use technologies such as Python, Spark, Airflow, Snowflake, Hive, FastAPI, etc. Maintaining data quality and accuracy across production data systems Working with Data Analysts to develop ETL processes for analysis and reporting Working with Product Managers to design and build data products Working with our team to scale and optimize our data infrastructure Participate in architecture discussions, influence the road map, take ownership and responsibility over new projects Participating in on-call rotation ...

About The Role Job Title - S&C Global Network - AI - CMT DE- Consultant Management Level:9- Consultant Location:Open Must-have skills: Data Engineering Good to have skills: Ability to leverage design thinking, business process optimization, and stakeholder management skills. Job Summary : We are looking for a passionate and results-driven Data Engineer to join our growing data team. You will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure that support data-driven decision-making across the organization. Roles & Responsibilities: Design, build, and maintain robust, scalable, and efficient data pipelines (ETL/ELT). Work with structured and uns...

About The Role Skill required: Data Management - Structured Query Language (SQL) Designation: Data Eng, Mgmt & Governance Sr Analyst Qualifications: BE/BTech Years of Experience: 5 to 8 years What would you do? Were Accenture Marketing Operations. Were the global managed services arm of Accenture Interactive. We sit in the Operations Business to take advantage of the industrialized run capabilities leveraging investments from Accenture Operations.Our quest is to activate the best experiences on the planet by driving value across every customer interaction to maximize marketing performance. We combine deep functional and technical expertise to future-proof our clients business while accelerat...

About The Role Project Role : AI / ML Engineer Project Role Description : Develops applications and systems that utilize AI tools, Cloud AI services, with proper cloud or on-prem application pipeline with production ready quality. Be able to apply GenAI models as part of the solution. Could also include but not limited to deep learning, neural networks, chatbots, image processing. Must have skills : Machine Learning Operations Good to have skills : NA Minimum 7.5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Machine Learning Engineer/MLOps Expert, you will engage in the operationalization of Machine Learning Models that leverage art...