15348 Airflow Jobs - Page 44

About The Role S&C GN - MC - Industry X - Intelligent Asset Management – Consultant Industrial AI Consultant - Maintenance & Reliability 7–8 years Location focus: India / Argentina / Kuala Lumpur Reporting: Reports to Senior Manager / Associate Director (no direct reports, but expected to mentor junior analysts) Team context: Embedded within Strategy & Consulting; leads client modules in partnership with functional consultants and data science teams. Role Summary As a Consultant you will play an expanded role in shaping client engagements "” from identifying business opportunity to driving pilots toward scaled deployments. This role requires stronger strategic thinking, proven delivery exper...

Role & responsibilities :- Design and implement modern data architectures across cloud and hybrid environments. Develop and optimize data pipelines and ETL/ELT processes for high-volume, high-velocity data. Lead data platform modernization initiatives using cutting-edge tools and frameworks. Define and enforce data governance, security, and compliance standards. Partner with Data Science, BI, and Product teams to ensure data availability, accuracy, and performance. Provide technical leadership and mentorship to data engineers and developers. Implement DevOps/Data Ops practices for automated testing, deployment, and monitoring. Continuously evaluate and introduce innovative data technologies ...

About The Role Project Role : Application Developer Project Role Description : Design, build and configure applications to meet business process and application requirements. Must have skills : Data Engineering Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Senior Data Engineer, you bring experience in applying advanced concepts and technologies in production environments.Your expertise and skills make you an ideal candidate to lead and deliver cutting-edge data solutions. Roles and Responsibilities Experience with Infrastructure as Code (IaC), preferably using Terraform. Proficiency in CI/CD pipelin...

About The Role Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : PySpark Good to have skills : NA Minimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, facilitating discussions to address challenges, and guiding your team in implementing effective solutions. You will also engage...

Job Title: Data Engineer About VXI VXI Global Solutions is a BPO leader in customer service, customer experience, and digital solutions. Founded in 1998, the company has 40,000 employees in more than 40 locations in North America, Asia, Europe, and the Caribbean. We deliver omnichannel and multilingual support, software development, quality assurance, CX advisory, and automation & process excellence to the world’s most respected brands. VXI is one of the fastest growing, privately held business services organizations in the United States and the Philippines, and one of the few US-based customer care organizations in China. VXI is also backed by private equity investor Bain Capital. Our initi...

Our Company Changing the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies interact with customers across every screen. We’re on a mission to hire the very best and are committed to creating exceptional employee experiences where everyone is respected and has access to equal opportunity. We realize that new ideas can come from everywhere in the organization, and we know the next big idea could be yours! Adobe's Genuine engine...

About the Role Were on a mission to completely change the way healthcare works by building the most powerful Healthcare Intelligence Platform ever made. Using an AI-first approach , our goal is to turn complicated health data into real-time insights that help hospitals, clinics, pharmaceutical companies, and researchers make faster, smarter decisions. We're building a unified platform from the ground up specifically for healthcare . This platform will bring together everything from: Collecting data from different systems (Data Acquisition) Combining and cleaning it (Integration, Data Quality) Managing patient records and provider info (Master Data Management) Tagging and organizing it (Data ...

We are looking for a highly skilled and experienced Cloud Data Engineer to join our team at Apple India Pvt Ltd. The ideal candidate will have a strong background in designing, developing, and implementing data engineering solutions on cloud platforms. Roles and Responsibility Design and develop scalable and efficient data pipelines using cloud-based technologies. Collaborate with cross-functional teams to identify and prioritize project requirements. Develop and maintain large-scale data architectures on cloud platforms such as AWS or Azure. Ensure data quality and integrity by implementing data validation and testing procedures. Optimize data processing workflows to improve performance and...

Once you join our team you will have the opportunity to Access experts across industries for maximum learning opportunities including Weekly Knowledge Sharing Sessions, LinkedIn Learning, and more. Gain exposure to a rich variety of research techniques from knowledgeable professionals. Enjoy a remote first/hybrid work environment with a flexible schedule. Obtain insights into the needs and challenges of your clientsto learn how the worlds leading brands use research. Experience peace of mind working for a company with a commitment to conducting research ethically. Build lasting relationships with fun colleagues in a culture that values each person Position Specifications: Should have 6+ year...

Job Description Some careers shine brighter than others. If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions. We are currently seeking an experienced professional to...

Join us as a DevOps Engineer This is an opportunity for a driven individual to take on an exciting new career challenge Youll be able to build and maintain a wide network of stakeholders of varying degrees of seniority Its a chance to have a tangible effect on our function, put your existing skills to the test and advance your career We're offering this role at associate level What you'll do You'll be working with platform and feature teams to develop, build and configure DevOps tools, technologies, techniques, patterns, and processes, and create trusted pipelines of work from development through to production environments utilising high degrees of automation. Youll also: Contribute to build...

Key Responsibilities Design, develop, and optimize ETL pipelines using PySpark on Google Cloud Platform (GCP) . Work with BigQuery , Cloud Dataflow , Cloud Composer (Apache Airflow) , and Cloud Storage for data transformation and orchestration. Develop and optimize Spark-based ETL processes for large-scale data processing . Implement best practices for data governance, security, and monitoring in a cloud environment. Collaborate with data engineers, analysts, and business stakeholders to understand data requirements. Troubleshoot performance bottlenecks and optimize Spark jobs for efficient execution. Automate data workflows using Apache Airflow or Cloud Composer . Ensure data quality, valid...

Greetings from Tata Consulting Services!!! Role: Data Engineer with Mandatory Pyspark, Python Knowledge Desired Experience Range: 5 to 10 yrs Location: Pune, Hyderabad, Chennai, Bangalore, Kochi, Bhubaneshwar Notice period: 0 To 30 Days Interview Mode: Virtual Mode Interview Date: 13th Nov 2025 Time Of Interview: 10AM TO 2PM Required Technical Skill Set: Python, Pyspark, Big Query Desired Competencies (Technical/Behavioral Competency) Development, Production Support and delivery of Python, BigQuery, SQL, GCP, Airflow based applications. Resource should have experience in Astronomer DAGS, Python, Pyspark, GCP, BigQuery. Collaborate with cross-functional teams including designers, product owne...

Position: Data Scientist Experience: 4–5 Years (relevant Data Science experience) Location: Pune / Hyderabad / Bangalore Budget: 15LPA Key Skills: Strong hands-on experience in Python (pandas, NumPy, scikit-learn, TensorFlow, PyTorch) or R Solid understanding of Machine Learning , Statistical Modeling , and Data Mining Expertise in Data Visualization (Power BI, Tableau, Matplotlib, Seaborn) Strong SQL and experience with data pipelines (Airflow, Spark, etc.) Proficiency with Cloud ML platforms (AWS SageMaker / Azure ML / Google AI Platform) Nice to Have: Exposure to Deep Learning , NLP , Time Series Analysis Familiarity with MLOps / CI-CD pipelines Certifications or project portfolios in Dat...

Role & responsibilities 1. Technical Leadership & Strategy: Lead the end-to-end architecture, design, and development of advanced AI/ML models (e.g., Deep Learning, NLP, Computer Vision, Predictive Analytics) for healthcare applications. Define the technical vision and roadmap for AI projects, ensuring alignment with business goals and clinical needs. Provide technical guidance and mentorship to a team of data scientists and machine learning engineers while fostering innovation within the team. Stay at the forefront of AI research, evaluating and incorporating state-of-the-art techniques into our solutions. 2. Solution Design & Development: Architect and build ML pipelines for diverse health...

Company Description Elevatoz specializes in creating and managing channel loyalty, customer loyalty, and employee rewards and recognition programs. Our solutions are based on a deep understanding of human behavior, cutting-edge technology, and comprehensive program design to ensure consistent results. We design, launch, and optimize loyalty and engagement programs for channel partners and customers, powered by our user-friendly technology platform. Our expertise spans multiple domains, enabling us to partner with some of the biggest brands in the country. Role Description We are looking for a highly motivated Manager- Data Analytics with strong technical, analytical, and business skills to d...

Role: Data Engineer Experience: 5-10 Years Location: Bannerghatta Road, Bangalore Work Mode: Onsite (5 days a week) Notice Period: Immediate Joiners Preferred Key Skills: Databricks, PySpark Responsibilities: Develop, optimize, and maintain scalable data pipelines using Databricks and PySpark . Manage data integration, transformation, and loading from multiple sources. Ensure data quality, reliability, and performance across platforms. Collaborate with data scientists and analysts to support analytical models and dashboards. Troubleshoot issues and provide production-level data support. Requirements: 510 years of hands-on experience in data engineering . Strong programming experience with Py...

Role Proficiency: This role requires proficiency in data pipeline development including coding and testing data pipelines for ingesting wrangling transforming and joining data from various sources. Must be adept at using ETL tools such as Informatica Glue Databricks and DataProc with coding skills in Python PySpark and SQL. Works independently and demonstrates proficiency in at least one domain related to data with a solid understanding of SCD concepts and data warehousing principles. Outcomes: Collaborate closely with data analysts data scientists and other stakeholders to ensure data accessibility quality and security across various data sources.rnDesign develop and maintain data pipelines...

Role & Responsibilities We are seeking a highly skilled Senior DevOps Engineer with 8+ years of hands-on experience in designing, automating, and optimizing cloud-native solutions on AWS. AWS and Linux expertise are mandatory. The ideal candidate will have strong experience across databases, automation, CI/CD, containers, and observability, with the ability to build and scale secure, reliable cloud environments. Key Responsibilities Cloud & Infrastructure as Code (IaC)- Architect and manage AWS environments ensuring scalability, security, and high availability. Implement infrastructure automation using Terraform, CloudFormation, and Ansible. Configure VPC Peering, Transit Gateway, and Privat...

We are looking for a passionate and detail-oriented Software Engineer to join our Big Data / Data Warehouse (DWH) / ETL team. The ideal candidate should have a strong understanding of data systems, data processing pipelines, and an interest in large-scale data analytics. Fresh graduates with relevant academic projects or training in data engineering are also welcome to apply. Responsibilities Design, develop, and maintain ETL pipelines for efficient data extraction, transformation, and loading. Work with Big Data technologies (Hadoop, Spark, Hive, etc. ) to process and analyse large datasets. Develop and maintain data warehouse models and ensure data integrity and consistency. Optimise and t...

Your Opportunity As an architect, you will get the opportunity to grow in the field of high-performance computing, complex system design and low-level optimizations for better cost of ownership. Roles and Responsibility As a Software Architect, you will be responsible for designing and implementing High performance computing software solutions for our organization. You will work closely with cross-functional teams, including software engineers, product managers, and business stakeholders, to understand requirements and translate them into architectural/software designs that meet business needs. You will be coding and developing quick prototypes to establish your design with real code and dat...

Description: Skills: Proficiency in SQL is a must. PL/SQL to understand integration SP part. Experience in PostgreSQL is must. Basic knowledge of Google Cloud Composer ( or Apache Airflow). Composer is managed GCP service for Apache Airflow. All pipelines are orchestrated and scheduled through Composer GCP basics-high level understanding of using GCP UI and services like Cloud SQL PostgreSQL Cloud Composer Cloud Storage Dataproc Airlfow DAGs are written in Python basic knowledge of Python code for DAGs Dataproc is Managed Spark in GCP so a bit of PySpark knowledge is also nice to have. Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade :C Level :To Be ...

Description: Objective:Build and maintain data pipelines and infrastructure to support data storage and processing. Key Responsibilities: -Design develop and optimize data pipelines using Azure Databricks. -Ensure data reliability scalability and quality. -Integrate data sources into a unified platform. -Monitor and troubleshoot data workflows. Skills Required: -Expertise in Azure Databricks Spark and big data tools. -Strong programming skills (e.g. Python Scala SQL). -Knowledge of ETL processes and cloud technologies. -Familiarity with CI/CD practices for data pipelines Named Job Posting? (if Yes - needs to be approved by SCSC) Additional Details Global Grade :C Level :To Be Defined Named J...

Python Developer Exp- 5-9yrs Max salary 25lpa-28lpa Pune and Hyd (Hybrid -WFO) Fixed rate - FTE Python Data Integration Engineer :Are you a seasoned data engineer with a passion for both hands-on technical work? Do you thrive in an environment that values innovation, collaboration, and cutting-edge technologies? We are seeking an experienced Data Integration engineer to spearhead our data integration strategies and initiatives. The ideal candidate will possess deep technical expertise in Python programming, Snowflake data warehousing, AWS cloud services, Kubernetes (EKS), CI/CD methodologies, Apache Airflow, dbt, Kafka for real-time data streaming, and API development. This role is pivotal i...

Description Key job responsibilities include, but are not limited to Become involved with day-to-day operations in Production Control. Understand the workflows and be able to troubleshoot issues and define new workflows in PCS and Control-M Design Airflow infrastructure according to the industry best practices. Work with System Administrators, Platform Engineers, Network, Firewall and Monitoring teams on the implementation of the infrastructure. Document the system's specifics, define, and implement administrative controls and policies of Airflow. Work with the development teams to identify the groups of jobs to migrate to airflow. Assist the development teams with the migrationsdefine DAGs,...