10863 Airflow Jobs - Page 30

Join us as a Quality Automation Specialist In this key role, youll be undertaking and enabling automated testing activities in all delivery models Well look to you to support teams to develop quality solutions and enable continuous integration and assurance of defect free deployment of customer value Working in a fast paced environment, you'll benefit from great variety in your work as well as excellent exposure as you work closely with a variety of people across the bank We're offering this role at vice president level What you'll do As a Quality Automation Specialist, youll be contributing to the transformation of testing using quality processes, tools and methodologies, significantly impr...

Key Responsibilities Design, develop, and maintain scalable and efficient data pipelines for batch and real-time processing. Work extensively with Databricks and PySpark to process and transform large datasets. Write complex and optimized SQL queries for data extraction, transformation, and analysis. Develop robust ETL/ELT processes to integrate data from various structured and unstructured sources. Collaborate with data scientists, analysts, and business stakeholders to ensure reliable and accessible data. Implement best practices for data quality, governance, and security on the AWS cloud platform. Monitor and troubleshoot data workflows to ensure high availability and performance. Contrib...

Our Client is a leading company in the tech industry, known for its innovation, growth opportunities, and excellent workplace culture. Role Summary Our Client is seeking a Data Engineer (Python + GCP) to join their team in a contract position. This hire is crucial for supporting ongoing growth and innovation within the company. As a Data Engineer, you will play a vital role in driving strategic initiatives and making a significant impact on the data infrastructure. Responsibilities Develop and maintain data pipelines using Python within the Google Cloud Platform (GCP) environment. Collaborate with cross-functional teams to gather requirements and implement efficient data solutions. Design an...

Job Profile: Data Engineer Experience: 4-5 Years Who we are: Innovatics is a place where innovation blends with analytics. We, Innovatics, take pride in knowing the notion of bleeding-edge technologies, strategic business moves, and radiant business transformation. We deliver never thought before business growth opportunities and assist businesses to accelerate their digital transformation journey. About the role: We're looking for a Data Engineer who's passionate about delivering tangible results, who has a positive attitude, and who enjoys solving problems. Requirements: Technical Skills: 4-5 years of experience in a Data Engineer role, Experience with object-oriented/object function scrip...

We are seeking a Senior Software Engineer (ETL) with 10-12 years of experience to join our ETL Development team. This role will report to the Engineering Manager and the candidate will be involved in the planning, design, and implementation of our centralized data warehouse solution for data acquisition, Ingestion and large data processing and automation/optimization across all the company products. About the Role: Candidate will play a crucial role in designing, developing, and leading the implementation of ETL processes and data pipeline solutions. Will collaborate with various stakeholders to ensure the seamless integration, transformation, and loading of data to support our data warehous...

Job Description: DevOps Engineer Company Overview We are a dynamic and innovative tech company focused on delivering high-quality solutions to our clients. Our team is dedicated to leveraging the latest technologies and best practices in the industry to ensure our products and services meet the highest standards of performance, reliability, and security. Position: DevOps Engineer Location: Mohali Employment Type: Full-Time Job Summary We are seeking a skilled DevOps Engineer with extensive experience in AWS, Terraform, Kubernetes, and related technologies. The ideal candidate will be responsible for managing our cloud infrastructure, automating deployment processes, and ensuring the reliabil...

About The Role Role Purpose The purpose of the role is to support process delivery by ensuring daily performance of the Production Specialists, resolve technical escalations and develop technical capability within the Production Specialists. Do Oversee and support process by reviewing daily transactions on performance parameters Review performance dashboard and the scores for the team Support the team in improving performance parameters by providing technical support and process guidance Record, track, and document all queries received, problem-solving steps taken and total successful and unsuccessful resolutions Ensure standard processes and procedures are followed to resolve all client que...

Responsibilities: Work closely with product managers to understand customer needs and translate those into technical requirements. • Build and maintain scalable data management and serving infrastructure on cloud, managing terabytes of data and integrating cost. • Design a comprehensive target data architecture vision working closely with product, design and development and NatCo teams to plan transition towards the target vision • Responsible for implementation of architecture concepts in product development and services • Consult and engage with engineering teams to solve problems at their root cause • Create deliverables that provide exceptional clarity and connections to business objecti...

Job Title: Senior ETL Developer – Complex Data Flows & High-Performance Systems Location: Gurugram Experience: 3+ years Department: Data Engineering / Analytics Job Summary: We are looking for a highly skilled ETL Developer with extensive experience in managing complex data flows , designing scalable pipelines, and optimizing performance in large data environments. The ideal candidate should have hands-on experience with ETL tools , strong knowledge of PostgreSQL , and the capability to manage environments with thousands of processors (e.g., 5000+ in a single PG setup) . Key Responsibilities: Design, build, and maintain robust ETL pipelines for large-scale and complex datasets Develop, optim...

Role & responsibilities Job Description : Sr. GCP Data Engineer Experience : 6 to 13 Years Work location : Chennai, Bangalore, Hyderabad, Pune-Hybrid Shift Timing : 2 to 11 PM I nterview proces s : L1 and L2 round Job description: 6+ years experience Should have experience in GCP BigQuery, DataProc(PySpark) Good to have experience on Informatica Preferred candidate profile Share your update resume on Nikita.solunke@ascendion.com and Do revert with below mentioned details. 1) Total year of experience- 2) Relevant year of experience- 3) Current CTC- 4) Expected CTC- 5) Notice Period- 6) Current Location- 7) Preferred Location-

Our technology services client is seeking multiple GCP Data Engineer to join their team on a contract basis. These positions offer a strong potential for conversion to full-time employment upon completion of the initial contract period. Below are further details about the role: Role: GCP Data Engineer Experience: 6- 10 Years Location: Chennai Notice Period: Immediate- 15 Days Mandatory Skills: GCP, Python, Big Query, SQL, Airflow, Data Flow Job Description: Knowledge on Google Cloud Platform Big Query SQL Dataflow with JavaPython Dataproc with PySparkPython Kafka or Pubsub Airflow and Cloud RunCloud function with Python 3 years of GCP experience GCP BQ and Python mandatory Experience on any ...

At Coface we make trade happen everyday Coface is a team of 5,200 people of 80 nationalities across nearly 58 countries, all sharing a corporate culture across the world. Together, we work towards one objective: facilitating trade by helping our 50,000 corporate clients develop their businesses. With 80 years of experience, Coface is a leader in the credit insurance and risk management market. We have also developed a range of other value-added services, including factoring, debt collection, Single Risk insurance, bonding, and information services. As a close-knit, international organisation at the core of the global economy, Coface offers an enriching work experience on several levels: rela...

We are seeking a highly skilled Kinematics Design Engineer specializing in automotive air vent systems. The candidate should have hands-on experience in the design, development, and validation of air vent kinematics, with a strong focus on CAD modeling, mechanism simulation, and integration into the interior system using CATIA V5/V6. Lead the mechanical design and kinematics development of automotive air vents (rotary, toggle, ball-type, shutter systems) Create and validate kinematic concepts for louvers, vanes, and control mechanisms Perform 3D modeling and mechanism simulation using CATIA (DMU Kinematics module) Ensure airflow functionality, tactile quality, and smooth actuation of mechani...

We are seeking a highly skilled n8n Automation Workflow Specialist with proven expertise in designing, implementing, and optimizing automation workflows. The ideal candidate will have hands-on experience in developing n8n workflows for diverse business use cases, integrating APIs, and streamlining processes through automation. This role is perfect for individuals who are passionate about process efficiency, data connectivity, and leveraging automation to drive business impact. Key Responsibilities Design, develop, and deploy complex automation workflows using n8n . Integrate multiple applications, databases, and APIs to create seamless data flows. Analyze business requirements and translate ...

We are looking for a Content Automation Specialist with strong Python and Data Engineering skills to help streamline and scale our content operations. This role focuses on automating workflows, managing large content libraries, and building tools that make content delivery faster and more efficient. Looking for data analysis and automation in travel domain experience Key Responsibilities Content Processing & Delivery 1. Build and maintain pipelines for processing and delivering video and digital content. 2. Ensure smooth handling of client-specific content requirements. Content Inventory Management 1. Maintain dashboards and inventories of processed and live content. 2. Identify content gaps...

Position Summary... As a member of Trust and Safety engineering team, you’ll be responsible for building scalable and resilient systems to keep Sams Club secure. The most critical ability we are looking for is your capacity to grasp new concepts/technologies & employ your skills creatively in solving problems to create state of art products/solutions. What you'll do... About The Team Sam's Club is membership-based club, a business model that provides members with high-quality products at prices that are unrivalled by traditional retail. Sam's Club provides a carefully curated assortment of items, as well as leading technologies and services such as Scan & Go, Club Pickup, and home delivery s...

Performs analysis tasks that utilize knowledge of business and accounting to direct or develop programming necessary to provide required audit tools to the audit site. Converts client data to PRGX standard formats by developing programs utilizing SQL programming languages. Under general supervision responds to requests from the audit staff for data conversion, standard reports, non-standard reports, and related support issues including analysis and programming. Assists other team members in evaluating, diagnosing, and correcting business application problems. Provides programming support to other staff members on business system design issues, custom applications, and programming issues as r...

Software development experience to build enterprise grade product solutions. Fluent with object oriented as well as functional programming Strong working knowledge on Core Python-2yr+ mandatory Strong experience designing, developing and documenting RESTful APIs and microservices preferably using Java, springboot. Prior experience building data engineering pipelines and processing big data workloads preferably using Apache Spark, Apache Airflow. Prior experience designing and developing event driven, high data volume multi-tenant SaaS architectures and platforms. Strong knowledge of source code management process preferably using git-flow model. Prior experience working in agile based scrum ...

About Company : They balance innovation with an open, friendly culture and the backing of a long-established parent company, known for its ethical reputation. We guide customers from what’s now to what’s next by unlocking the value of their data and applications to solve their digital challenges, achieving outcomes that benefit both business and society. About Client: Our client is a global digital solutions and technology consulting company headquartered in Mumbai, India. The company generates annual revenue of over $4.29 billion (₹35,517 crore), reflecting a 4.4% year-over-year growth in USD terms. It has a workforce of around 86,000 professionals operating in more than 40 countries and se...

Job Title: Lead Data Engineer Primary Skill: Apache airflow, Python, SQLServer, SnowSQL, Snowflake, Azure Databricks, Databricks, Azure DevOps, Docker, Kubernete Type of Work: Hybrid Working Hours: IST Resource Experience (in years):6- 12 Years: Job Description: As a Lead Data Engineer, you will: Develop and maintain scalable data pipelines to support operational and analytical needs. Collaborate with data scientists, analysts, and business teams to understand data requirements and deliver solutions that align with organizational goals. Optimize and maintain cloud-based data infrastructure (e.g., Snowflake, Azure) for performance and cost-efficiency. Ensure the integrity, reliability, and se...

Role Overview: You will be a specialist working with Large Language Models (LLMs) to design, develop, and integrate advanced AI solutions within the platform. Your main responsibilities will include automating data processing, generating actionable insights, and enhancing decision-making workflows. Your focus will be on building scalable solutions that improve efficiency, accuracy, and user experience through natural language understanding. Key Responsibilities: - Design, develop, and optimize NLP models for text processing, classification, and information extraction. - Apply machine learning and AI techniques to solve real-world business problems. - Collaborate with cross-functional teams t...

Key Responsibilities Build, scale, and maintain robust data solutions to support business objectives. Design, implement, and optimize high-performance data pipelines (extraction, loading, transformation, and orchestration) with scalability, reliability, and speed. Lead end-to-end software development projects involving large language models (LLMs), retrieval-augmented generation (RAG) frameworks, and other AI technologies. Champion modern software engineering practices such as CI/CD, infrastructure-as-code, containerization, and cloud-native deployments. Collaborate with business stakeholders to transform use cases into production-ready services and solutions, owning systems from concept to ...

About The Role We are looking for a highly skilled and motivated Senior Data Engineer to join our team. In this role, you will be responsible for designing, building, and maintaining scalable and robust data pipelines and architectures that support business intelligence, analytics, and machine learning initiatives. You will collaborate closely with data scientists, analysts, and software engineers to ensure the availability, quality, and security of data across the organization. Key Responsibilities Design, develop, and maintain scalable data pipelines and ETL workflows using orchestration tools such as Apache Airflow or dbt. Architect and implement data integration solutions that consolidat...

Company Overview Milestone Technologies is a global IT managed services firm that partners with organizations to scale their technology, infrastructure and services to drive specific business outcomes such as digital transformation, innovation, and operational agility. Milestone is focused on building an employee-first, performance-based culture and for over 25 years, we have a demonstrated history of supporting category-defining enterprise clients that are growing ahead of the market. The company specializes in providing solutions across Application Services and Consulting, Digital Product Engineering, Digital Workplace Services, Private Cloud Services, AI/Automation, and ServiceNow. Milest...

At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals. In data analysis at PwC, you will focus on utilising advanced analytical techniques to extract insights from large datasets and drive data-driven decision-making. You will leverage skills in data manipulation, visualisation, and statistical modelling to support clients in solving complex business problems. PwC US - Acceleration Center is seeking a highly strong analytical background to work in our Analytics Consulting practice Senior Associate’s will wor...