19344 Airflow Jobs - Page 2

Hands-on individual responsible for producing excellent quality of code, adhering to expected coding standards and industry best practices. Must have strong experience in Java, Python , Airflow exp microservices, Spring and SQL. Good knowledge of Spring, Hibernate, JMS, Caching Frameworks, Memory Management Nice to have Kubernetes , Docker. Problem- solving/ Trouble shooting skills High levels of ownership and commitment on deliverables Strong Communication Skills - Should be interact with client stakeholders to probe a technical problem or clarify requirement specifications Mandatory Competencies Programming Language - Java - Core Java (java 8+) Programming Language - Java - Spring Framewor...

We are seeking an experienced and Senior DevOps Engineer to lead the deployment of Docker container-based applications and API-driven microservices built in Python , running on Kubernetes within our Ascend Platform . This role will be instrumental in driving innovation, streamlining deployment workflows, and enhancing team efficiency through established CI/CD pipelines and industry best practices. Key Responsibilities: DevOps Leadership : Architect and manage scalable, secure, and resilient infrastructure for containerized applications and microservices. CI/CD Ownership : Maintain and evolve CI/CD pipelines to ensure rapid and reliable delivery of software. Platform Expertise : Oversee deplo...

As a SQL and PL/SQL Expert, your role will involve the following key responsibilities: - Hands-on experience with DBT, ensuring practical application rather than just theoretical knowledge. - Ability to reverse engineer Oracle code and convert it into DBT models. - Familiarity with high-volume data processing to handle large datasets efficiently. - Optional experience with Java (preferred but not mandatory) and knowledge of Airflow (preferred but not mandatory). - Suggesting performance improvements such as clustering and merge optimization. - Working independently with minimal supervision. - Collaborating with existing frameworks and standards to ensure seamless integration. No additional d...

As an experienced AI/ML Architect, you will be responsible for architecting and deploying enterprise-scale AI/ML platforms. Your role will involve working in agile, cross-functional teams to deliver measurable impact. With a Masters or PhD in Computer Science, Artificial Intelligence, Machine Learning, or a related quantitative field, you should have 8+ years of experience in this domain. Your key responsibilities will include: - Designing, implementing, and scaling AI infrastructure using technologies such as Databricks, Azure AI, Snowflake, Spark, and Airflow. - Hands-on experience with model selection, fine-tuning, evaluation, and responsible AI governance. - Strong programming skills in ...

You will be responsible for transforming Data Science prototypes into production-ready applications, building scalable MLOps pipelines, and maintaining deployed models. This role requires a strong background in software engineering, cloud infrastructure, and practical experience with the full ML lifecycle. - Refactor and optimise Data Science prototypes for performance and efficiency. - Containerise models using Docker and deploy them onto a scalable infrastructure, such as Kubernetes. - Design and build low-latency APIs to serve model predictions in real-time. - Implement CI/CD/CT pipelines to automate model training, testing, and deployment processes. - Utilise orchestration tools like Air...

Role Overview: As a Lead Programmer Analyst specializing in GCP Data Engineering, you will be responsible for utilizing your extensive experience and skills in data engineering to lead and drive projects related to Google Cloud Platform (GCP). Your primary focus will be on developing solutions using GCP services such as BigQuery, DataProc, Dataflow, and Dataform. Additionally, you will be required to have a strong command over SQL, Python, and Pyspark to effectively fulfill your responsibilities. Key Responsibilities: - Utilize your 5 to 7 years of data engineering experience to design and implement solutions using GCP services. - Develop and maintain data pipelines using tools like BigQuery...

As a Data / AI / ML Engineer at our company, you will play a crucial role in designing, developing, and deploying data-driven solutions that power intelligent systems across various business domains. You will collaborate closely with data scientists, software engineers, and product managers to build robust data pipelines, optimize machine learning models, and ensure scalable, efficient, and reliable AI/ML solutions in production environments. Key Responsibilities: - Design, build, and maintain scalable data pipelines and ETL processes. - Support the development and deployment of machine learning models into production. - Collaborate with cross-functional teams to understand data requirements...

As a Data Services ETL Developer at Zeta, you will specialize in data transformations and integration projects using proprietary tools, 3rd Party software, and coding. Your role will involve implementing data processing across multiple technologies to ensure accurate and on-time delivery for marketing operations. Responsibilities: - Manipulate client and internal marketing data across various platforms. - Automate scripts for data transfer and manipulation. - Build, deploy, and manage cloud-based data pipelines using AWS services. - Manage multiple tasks with competing priorities for timely client deliverability. - Collaborate with technical staff to maintain and support a proprietary ETL en...

Looking for a Data Engineer (Python+ Linux Developer) with a strong background in Python, data engineering, data modeling, SQL Server, and SDLC *Must have : Hands-on experience on Linux with Python, PySpark, Airflow, MySql, Linux* Hybrid work

Description We are looking for an experienced and results-driven Data Engineer to join our growing Data Engineering team. The ideal candidate will be proficient in building scalable, high-performance data transformation pipelines using Snowflake and dbt or Matillion and be able to effectively work in a consulting setup. In this role, you will be instrumental in ingesting, transforming, and delivering high-quality data to enable data-driven decision-making across the clients organization. Key Responsibilities Design and implement scalable ELT pipelines using dbt on Snowflake, following industry accepted best practices. Build ingestion pipelines from various sources including relational databa...

Qualifications B.Tech./M.Tech/M.S./PhD in Computer Science, Statistics, Mathematics, Economics, or related quantitative field (advanced degree preferred). Minimum 8+ years of experience in data analytics, business intelligence, or quantitative research, including at least 3 years leading analytics initiatives. Key Responsibilities Oversee the design and implementation of analytics frameworks for platform performance monitoring and user behaviour analysis, aligning with SIDH's objectives as a Digital Public Infrastructure. Oversee development of real-time dashboards for tracking skill acquisition, certification rates, employment outcomes, and scheme effectiveness across government programs. E...

Job Overview As a Data Scientist, you will play a key role in delivering end-to-end data science solutions across pharmaceutical and healthcare engagements. The role demands a blend of technical depth, business acumen, and scientific curiosity. You will translate complex business problems into analytical frameworks, develop scalable machine learning and statistical solutions, and generate actionable insights that drive commercial, clinical, and operational impact for clients and patients worldwide. Beyond technical execution, you are expected to think strategically, framing business challenges, designing analytical approaches, and guiding clients toward the most effective data-driven decisio...

Job Description – Precision Air Conditioning (PAC) OperatorPosition: Precision Air Conditioning Operator Role Summary The Precision Air Conditioning (PAC) Operator is responsible for operating, monitoring, and maintaining precision cooling systems in a data center environment to ensure optimal temperature and humidity levels. The role requires continuous monitoring, quick response to fluctuations, and routine maintenance to support uninterrupted data center operations. Key Responsibilities1. System Operation & Maintenance Operate precision air conditioning (PAC) / CRAC / CRAH units on a 24/7 basis to maintain required environmental conditions. Perform routine preventive maintenance as per sc...

HMH is a learning technology company committed to delivering connected solutions that engage learners, empower educators and improve student outcomes. As a leading provider of K–12 core curriculum, supplemental and intervention solutions, and professional learning services, HMH partners with educators and school districts to uncover solutions that unlock students’ potential and extend teachers’ capabilities. HMH serves more than 50 million students and 4 million educators in 150 countries. HMH Technology India Pvt. Ltd. is our technology and innovation arm in India focused on developing novel products and solutions using cutting-edge technology to better serve our clients globally. HMH aims ...

HMH is a learning technology company committed to delivering connected solutions that engage learners, empower educators and improve student outcomes. As a leading provider of K–12 core curriculum, supplemental and intervention solutions, and professional learning services, HMH partners with educators and school districts to uncover solutions that unlock students’ potential and extend teachers’ capabilities. HMH serves more than 50 million students and 4 million educators in 150 countries. HMH Technology India Pvt. Ltd. is our technology and innovation arm in India focused on developing novel products and solutions using cutting-edge technology to better serve our clients globally. HMH aims ...

Project Role : Custom Software Engineer Project Role Description : Develop custom software solutions to design, code, and enhance components across systems or applications. Use modern frameworks and agile practices to deliver scalable, high-performing solutions tailored to specific business needs. Must have skills : Snowflake Data Warehouse Good to have skills : Data Building Tool Minimum 3 Year(s) Of Experience Is Required Educational Qualification : 15 years full time education Job Title: Data Platform Support Engineer (Snowflake / dbt / Fivetran / Maestro) Role Overview: We are looking for a Data Platform Support Engineer to monitor and maintain our Unified Data Platform (UDP) built on Sn...

Grid Dynamics wants to build a centralized, observable and secure platform for their ML, Computer Vision, LLM and SLM models. Grid Dynamics wants to onboard a vast number of AI agents, able to cover multiple required skills, ensuring a certain level of control and security in regards to their usage and availability. The observable platform must be vendor-agnostic, easy to extend to multiple type of AI applications and flexible in terms of technologies, frameworks and data types. This project is focused on establishing a centralized LLMOps capability where every ML, CV, AI-enabled application is monitored, observed, secured and provides logs of every activity. The solution consists of key bui...

TCS is Hiring for AWS Data Engineer & Python Skill: AWS Data Engineer & Python Experience: 05-10 years (mandatory) Joining Location: PAN INDIA DRIVE MODE : In-Person Drive WALK IN DRIVE DATE: 08th January 2026 **WALK IN DRIVE LOCATION: Chennai ** ROLES AND RESPONSIBILITIES: Create and maintain optimal data pipeline architecture for efficient and reliable data processing Assemble large, complex data sets that meet functional / non-functional business requirements. Database management, ETL process, Data modelling, ensuring data quality and integrity. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure...

Company: AA GLOBUSDIGITAL INDIA PRIVATE LIMITED AA GLOBUSDIGITAL INDIA PRIVATE LIMITED, is a wholly owned subsidiary of Globus Systems Inc US, Globus Systems was founded by industry executives who have been part of the IT services industry for the past 20 years and have seen it evolve and mature. We understand the challenges faced by organizations as they prepare for the future. As a technology delivery company, we are focused on helping organizations lay a foundation for their "Tomorrow-Roadmap". At the heart of any business is the data that drives decisions. Data integrity and security are key drivers for growth. Smart and timely use of technology can help build, streamline and enable data...

Dear Professionals Greetings from TCS!!! Job Title : Senior Data Engineer (Snowflake, DBT, Azure) Experience : 5-8 Years Location : Only Bangalore/Chennai/Hyderabad/Pune Data Engineer: Required Skills and Qualifications • 5+ years of hands-on experience as a Data Engineer, with a strong portfolio of successful projects delivering robust, scalable, and reliable data solutions. • Strong proficiency in Microsoft SQL Server and Structured Query Language (SQL), including query optimization and advanced data querying. • Experience with scripting and programming languages, including PowerShell, Python, Scala, and working with Json, XML. • Solid experience leveraging technologies such as Snowflake, ...

What You'll Build Core Responsibilities Data Architecture & Infrastructure (40%) ● Design and implement a multi-database architecture (MongoDB, Redis, Milvus, Neo4j, BigQuery) ● Build scalable data pipelines for real-time conversation processing and personalization ● Architect ETL/ELT workflows for data migration from legacy systems ● Implement data partitioning, sharding, and optimization strategies for high-throughput systems ● Create data governance frameworks ensuring quality, security, and compliance Vector & Graph Database Systems (25%) ● Design and optimize Milvus vector collections for semantic search (1024-dim embeddings) ● Build graph schemas in Neo4j for customer journey mapping a...

About the Role We are looking for a highly skilled Data Engineer to design, build, and maintain robust data pipelines and scalable data infrastructure. You will work closely with analytics, product, and engineering teams to enable high-quality data availability for business insights, machine learning, and operational processes. This role is ideal for an engineer who enjoys solving complex data problems, optimizing systems, and ensuring clean, reliable data flows. Key Responsibilities Design, develop, and maintain scalable ETL/ELT pipelines using modern data engineering tools. Build and optimize data lakes, data warehouses, and streaming architectures . Work with large and complex datasets to...

Description At RBHU, we are committed to delivering data-driven solutions that empower decision-making. We work at the intersection of Data, AI, and Analytics, helping clients unlock the value of their data. We are now looking for an enthusiastic Data Engineer with hands-on Databricks experience to join our growing team. Key Responsibilities Develop, maintain, and optimize ETL/ELT pipelines using Databricks. Integrate data from multiple sources into scalable and reliable data solutions. Implement data transformations, cleansing, and enrichment processes. Work closely with data analysts, data scientists, and business teams to deliver analytics-ready datasets. Ensure data quality, performance,...

Description We are looking for an experienced and results-driven Data Engineer to join our growing Data Engineering team. The ideal candidate will be proficient in building scalable, high-performance data transformation pipelines using Snowflake and dbt or Matillion and be able to effectively work in a consulting setup. In this role, you will be instrumental in ingesting, transforming, and delivering high-quality data to enable data-driven decision-making across the clients organization. Key Responsibilities Design and implement scalable ELT pipelines using dbt on Snowflake, following industry accepted best practices. Build ingestion pipelines from various sources including relational databa...

Role Overview: As an AI/ML Engineer, your role will involve designing, building, and deploying end-to-end AI/ML systems in production. You will be required to demonstrate expertise in data science, including statistical analysis, experimentation, and data storytelling. Additionally, you will work with large-scale, real-world datasets for model training and analysis. Your strong leadership experience will be essential in building and guiding high-performing AI teams. Key Responsibilities: - Design, build, and deploy end-to-end AI/ML systems in production. - Demonstrate expertise in data science, statistical analysis, experimentation, and data storytelling. - Work with large-scale, real-world ...