15348 Airflow Jobs - Page 43

Role Overview: As a data engineering leader with over 15 years of experience in AI-driven environments, you will be responsible for designing and scaling enterprise-grade data architectures, models, and governance frameworks. Your expertise with tools like Databricks, Airflow, Apache Spark, RDBMS, storage, and cloud platforms (Azure/AWS/GCP) will be crucial in transforming legacy systems to modern, cloud-native data platforms. Additionally, your knowledge of LLMs, RAG, vectorization, and data compliance/security frameworks (preferably HIPAA/SOC2) will be instrumental in setting CI/CD/MLOps standards. Your background in DevOps environments and prior coding experience (.NET, SQL Server) will e...

About The Role As an Engineering Manager on the FinTech Data & ML Systems team , you will: Lead a high-performing team of data engineers and platform specialists in designing, implementing, and scaling data and ML solutions that power analytics, decision-making, and automation across FinTech. Drive the architecture and delivery of robust data pipelines, feature stores, and data platforms that enable machine learning and advanced analytics use cases. Collaborate closely with product managers, data scientists, and ML engineers to define and deliver reliable data and model workflows that support critical FinTech applications. Provide technical leadership in data architecture, ETL design, model ...

Education At Meazure Learning , we aim to empower open-minded, inquisitive, and driven people, and we love how each new addition to the team adds to our culture. Here, you can positively impact the careers of millions of test-takers and reshape the education technology landscape by working toward one vision: “To provide life-long learners across the globe the freedom to pursue their academic dreams and career aspirations safely, securely, and conveniently.” Our Vision starts with our values— Hungry, Humble, and Smart. We are looking for team members who model drive for results, think of the organization and team first without ego or agenda, and lead with emotional intelligence. This is the f...

JOB TITLE: Sr. Data Engineer EDUCATION / QUALIFICATIONS / EXPERIENCE : B.S. in Computer Science, Information Systems, or related field required, or 8+ years equivalent experience in data engineering. Proven experience designing, building, and optimizing cloud-native, scalable, cost-efficient data pipelines and architectures, particularly on Google Cloud Platform (preferred); familiarity with AWS or Azure is a plus. Advanced skills in Python and SQL, familiarity with dbt, Airflow, Terraform, CI/CD pipelines. Experience with batch and streaming technologies such as Kafka, Spark, Dataflow, and Pub/Sub. Expertise with GCP-native tools such as BigQuery, Cloud Functions, Cloud Workflows, GCS, and ...

Company Description BETSOL is a cloud-first digital transformation and data management company offering products and IT services to enterprises in over 40 countries. BETSOL team holds several engineering patents, is recognized with industry awards, and BETSOL maintains a net promoter score that is 2x the industry average. BETSOL’s open source backup and recovery product line, Zmanda (Zmanda.com), delivers up to 50% savings in total cost of ownership (TCO) and best-in-class performance. BETSOL Global IT Services (BETSOL.com) builds and supports end-to-end enterprise solutions, reducing time-to-market for its customers. BETSOL offices are set against the vibrant backdrops of Broomfield, Colora...

About MonetizeMore MonetizeMore is a global leader in ad tech, helping publishers maximize their ad revenue through advanced optimization, data, and automation. Our fully remote team is distributed across the world, driven by innovation, autonomy, and measurable impact. Role Overview We are looking for a Data Infrastructure Engineer to design, build, and maintain scalable data systems that support analytics, machine learning, and business intelligence at MonetizeMore. You will collaborate closely with data engineers, analysts, and product teams to ensure our data pipelines are reliable, efficient, and secure. In addition to core data infrastructure responsibilities, you will occasionally wor...

We are seeking a skilled and detail-oriented Data Engineer (Apache Flume) to join our team. The ideal candidate will have 4+ years of hands-on experience in development, with a strong grasp of Apache Flume, data modelling, and migration. You will work closely with cross-functional teams to deliver data-driven solutions that empower strategic decision-making across the organization. To lead the migration of existing logs from SQL Server databases to an Apache Flume application and establish a robust pipeline for daily log ingestion. The ideal candidate will have hands-on experience in data engineering, log management, and automation of ETL processes. Key Responsibilities Log Migration: Design...

About MonetizeMore MonetizeMore is a global leader in ad tech, helping publishers maximize their ad revenue through advanced optimization, data, and automation. Our fully remote team is distributed across the world, driven by innovation, autonomy, and measurable impact. Role Overview We are looking for a Data Infrastructure Engineer to design, build, and maintain scalable data systems that support analytics, machine learning, and business intelligence at MonetizeMore. You will collaborate closely with data engineers, analysts, and product teams to ensure our data pipelines are reliable, efficient, and secure. In addition to core data infrastructure responsibilities, you will occasionally wor...

At TEKsystems , were partnering with a global leader in data-driven digital transformation, and we're on the lookout for skilled Senior Data Engineers to build robust, scalable, and cloud-native data platforms. If you're passionate about designing high-performance data pipelines, working with cutting-edge cloud technologies, and driving insights across enterprise and analytics ecosystems – we want to hear from you! What we’re looking for: 8-10 years of Data Engineer experience Senior Data Engineer 8–10 years’ experience in design, architecture, or development in Analytics and Data Warehousing Must have 3+ years of experience in development projects using AWS/Cloud Services like S3, Glue, Ath...

About MonetizeMore MonetizeMore is a global leader in ad tech, helping publishers maximize their ad revenue through advanced optimization, data, and automation. Our fully remote team is distributed across the world, driven by innovation, autonomy, and measurable impact. Role Overview We are looking for a Data Infrastructure Engineer to design, build, and maintain scalable data systems that support analytics, machine learning, and business intelligence at MonetizeMore. You will collaborate closely with data engineers, analysts, and product teams to ensure our data pipelines are reliable, efficient, and secure. In addition to core data infrastructure responsibilities, you will occasionally wor...

About MonetizeMore MonetizeMore is a global leader in ad tech, helping publishers maximize their ad revenue through advanced optimization, data, and automation. Our fully remote team is distributed across the world, driven by innovation, autonomy, and measurable impact. Role Overview We are looking for a Data Infrastructure Engineer to design, build, and maintain scalable data systems that support analytics, machine learning, and business intelligence at MonetizeMore. You will collaborate closely with data engineers, analysts, and product teams to ensure our data pipelines are reliable, efficient, and secure. In addition to core data infrastructure responsibilities, you will occasionally wor...

Job Title: Snowflake Solution Architect Experience: 12 to 15 Years Location: [Specify Onsite/Hybrid/Remote] Employment Type: Full-time / Permanent Job Summary: We are looking for an experienced Snowflake Solution Architect to design, implement, and optimize enterprise data solutions using Snowflake on cloud platforms. The ideal candidate will have strong expertise in data architecture, cloud data warehousing, and analytics , with a proven track record of delivering scalable and high-performance data solutions. Key Responsibilities: Lead end-to-end architecture, design, and implementation of Snowflake-based data solutions. Develop data models, data pipelines, and ETL/ELT frameworks integratin...

Join us in building a next-gen Single Source of Truth (SSOT) data platform the foundation of our enterprise analytics strategy. You'll design high-performance Snowflake architectures , enforce governance and security, and optimize workloads that power insights across domains like e-commerce, stores, supply chain, and finance. Designation: Snowflake Lead / Architect Experience: 8 - 12+ Years 6+ months Contract to Hire What You'll Do Architect scalable Snowflake models (facts, conformed dimensions, semantic views) Implement RLS, masking, and SSO-based access governance Optimize performance with clustering, query insights, and autoscaling warehouses Integrate metadata and lineage with tools lik...

About Us: At Calfus, we are known for delivering cutting-edge AI agents and products that transform businesses in ways previously unimaginable. We empower companies to harness the full potential of AI, unlocking opportunities they never imagined possible before the AI era. Our software engineering teams are highly valued by customers, whether start-ups or established enterprises, because we consistently deliver solutions that drive revenue growth. Our ERP solution teams have successfully implemented cloud solutions and developed tools that seamlessly integrate with ERP systems, reducing manual work so teams can focus on high-impact tasks. None of this would be possible without talent like yo...

Senior Data Engineer (Ontology & Knowledge Graph Systems) We are seeking a Senior Data Engineer to design and implement a semantic data layer that unifies complex data assets across domains. This role focuses on building Palantir-style ontology and knowledge graph systems using open-source technologies to enable interpretability, analytics, and AI-driven workflows. Key Responsibilities Design and implement scalable ontology or knowledge graph models representing business and technical domains. Build and maintain data pipelines (batch and streaming) for ingesting, transforming, and mapping heterogeneous data into semantic structures. Develop and optimize storage and query layers using graph d...

Equifax is seeking creative, high-energy and driven software engineers with hands-on development skills to work on a variety of meaningful projects. Our software engineering positions provide you the opportunity to join a team of talented engineers working with leading-edge technology. You are ideal for this position if you are a forward-thinking, committed, and enthusiastic software engineer who is passionate about technology. What You’ll Do Design, develop, and operate high scale applications across the full engineering stack Design, develop, test, deploy, maintain, and improve software. Apply modern software development practices (serverless computing, microservices architecture, CI/CD, i...

Job Title: Cloud Data and AI Engineer, AVP Location: Pune, India Role Description We are seeking an experienced Cloud (GCP) Data and AI engineer to play a key role in development and implementation of AI and Data engineering solutions. Candidate will work as an Engineering Team member in collaboration with business function and will be responsible for building and deploying robust and scalable AI and data engineering solutions, in-line with bank's AI strategy, driven by business value to improve operational efficiency and enhance customer experience. Deutsche Bank's Corporate Bank division is a leading provider of cash management, trade finance and securities finance. We complete green-field...

Equifax is seeking creative, high-energy and driven software engineers with hands-on development skills to work on a variety of meaningful projects. Our software engineering positions provide you the opportunity to join a team of talented engineers working with leading-edge technology. You are ideal for this position if you are a forward-thinking, committed, and enthusiastic software engineer who is passionate about technology. What You’ll Do Design, develop, and operate high scale applications across the full engineering stack Design, develop, test, deploy, maintain, and improve software. Apply modern software development practices (serverless computing, microservices architecture, CI/CD, i...

Job Summary As a key member of the Data Team at Equinix, we are seeking an experienced GCP Data Engineer who will lead end-to-end development of complex Data Engineering use cases and drive the evolution of Equinix's Data Lake platform You will design and build enterprise-scale data infrastructure and analytics solutions on Google Cloud Platform while providing technical mentorship to the data engineering team The ideal candidate combines deep technical expertise in cloud-native data technologies with proven leadership skills and a passion for building robust, scalable data platforms that drive strategic business insights Responsibilities Participate in design and implementation of enterpris...

Job Summary Were looking for a Principal Cloud Engineer with a strong foundation in Multi-Cloud & multi region deployment, data architecture, distributed systems, and modern cloud-native platforms to architect, build, and maintain intelligent infrastructure and systems that power our AI, GenAI and data-intensive workloads. Youll work closely with cross-functional teams, including data scientists, ML & software engineers, and product managers & play a key role in designing a highly scalable platform to manage the lifecycle of data pipelines, APIs, real-time streaming, and agentic GenAI workflows, while enabling federated data architectures. The ideal candidate will have a strong background in...

What We Offer Location: Bangalore,IND Youll benefit from a supportive work culture that encourages you to learn, develop, and grow your career as you take on challenges and drive innovative solutions for our customers. We empower our team to push the boundaries of what is possiblewhile learning every day in a supportive leading global company. Visit our Careers website to learn more. At Applied Materials, we care about the health and wellbeing of our employees. Were committed to providing programs and support that encourage personal and professional growth and care for you at work, at home, or wherever you may go. Learn more about our . Our Team Our team is developing a high-performance comp...

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : PySpark Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, facilitating discussions to address challenges, and guiding your team in implementing effective solutions. You will also engage in strategic pl...

Hiring: Corporate Trainer – Data Engineering We’re looking for an experienced Data Engineering Trainer to deliver a 40-hour online corporate training for one of our clients. 📅 Start Date: 3rd week of November 🕕 Timing: 6 PM – 8 PM (Monday to Friday) 📍 Mode: Online Trainer Requirements: Must use their own training material Strong expertise in: Git, Docker, Data Modelling, MySQL, Data Warehousing, Hadoop, Spark, Delta Lake, Airflow, Databricks, AWS (S3, Lambda, Redshift, CloudWatch), Apache Kafka, and Spark Streaming. If you’re interested, share your resume at surabhi.barat@theodysvadhyay.co.in

Project Role : Application Lead Project Role Description : Lead the effort to design, build and configure applications, acting as the primary point of contact. Must have skills : PySpark Good to have skills : NAMinimum 5 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As an Application Lead, you will lead the effort to design, build, and configure applications, acting as the primary point of contact. Your typical day will involve collaborating with various teams to ensure project milestones are met, facilitating discussions to address challenges, and guiding your team in implementing effective solutions. You will also engage in strategic pl...

Skilled Multiple GCP services - GCS, BigQuery, Cloud SQL, Dataflow, Pub/Sub, Cloud Run, Workflow, Composer, Error reporting, Log explorer etc. Must have Python and SQL work experience & Proactive, collaborative and ability to respond to critical situation Ability to analyse data for functional business requirements & front face customer Required education Bachelor's Degree Preferred education Master's Degree Required technical and professional expertise 5 to 7 years of relevant experience working as technical analyst with Big Query on GCP platform. Skilled in multiple GCP services - GCS, Cloud SQL, Dataflow, Pub/Sub, Cloud Run, Workflow, Composer, Error reporting, Log explorer You love colla...