19344 Airflow Jobs - Page 6

Role & responsibilities • Design, develop, and maintain data pipelines using Snowflake, dbt, or Coalesce.• Write and optimize SQL queries within dbt for efficient data transformation in Snowflake.• Utilize Coalesce or similar data transformation tools to migrate data from MSSQL to Snowflake.• Cleanse, validate, and transform data to ensure accuracy and consistency.• Design and implement data models in dbt to transform raw data into analytical-ready datasets.• Automate data pipelines and ensure their reliability and scalability.• Collaborate with data analysts, data scientists, and business stakeholders to understand data needs and translate them into technical solutions.• Develop and impleme...

SUMMARY: We are seeking a Sr Data Engineer to join our team and leverage their expertise in Snowflake, dbt, and data transformation tools to build and maintain scalable data pipelines. You will be responsible for extracting, transforming, and loading (ETL) data from Microsoft SQL Server (MSSQL) into our Snowflake data warehouse, ensuring clean, reliable data for analysis and reporting. PRIMARY RESPONSIBILITIES Design, develop, and maintain data pipelines using Snowflake, dbt, or Coalesce.• Write and optimize SQL queries within dbt for efficient data transformation in Snowflake.• Utilize Coalesce or similar data transformation tools to migrate data from MSSQL to Snowflake.• Cleanse, validate,...

Role & responsibilities Design and implement scalable ELT pipelines using DBT and Snowflake Develop and optimize complex SQL queries and transformations Work with data loading/integration tools like StreamSets Collaborate with stakeholders to gather business requirements and translate them into technical solutions Version control and CI/CD using Git Schedule and monitor workflows using Apache Airflow (preferred) Leverage Python for custom data manipulation, scripting, and automation Ensure data quality, integrity, and availability across various business use cases Preferred candidate profile Strong expertise in DBT (Data Build Tool) Hands-on experience with Snowflake and ELT processing Profi...

Role & responsibilities Skill AWS Redshift Ops + PLSQL + Unix +Python + Airflow Job Description Incident Management Troubleshooting issues Contributing to development Collaborating with another team Suggesting improvements Enhancing system performance Training new employees

DotNet with Angular Developer 8+ yrs We’re looking for seasoned .NET Core engineers to build Ops Platform . You’ll design and implement microservices and containerized workloads, build modern Angular front‑ends, and craft robust SQL solutions. The ideal candidate brings strong engineering fundamentals, production experience with distributed systems, and a pragmatic test‑driven development (TDD) mindset. Below are the tasks that these positions will be responsible for Design & build secure, performant .NET Core (C#) services (REST/gRPC) following domain‑driven and 12‑factor principles. Model data and optimize SQL (indexes, query tuning, partitioning); contribute to schema evolution and migrat...

hackajob is collaborating with American Express to connect them with exceptional tech professionals for this role. At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. How will you make an impact in this role? Respon...

Job Description Join our AWS Data Engineer Walkin drive on 10th Jan'26 Years of Exp : 5-10 Years Primary Skillset: AWS,Python,SQL,Pyspark, Databricks and Data Modelling -Knowledge. Walkin Drive : 10th Jan'26 Time : 10.30 AM-3.00PM Registration Link For Walkin Drive: https://agilisium.zohorecruit.com/jobs/Careers/589705000033514003/Data-Engineer?source=CareerSite Venue: World Trade Center 1st floor of Tower B, 5/142, Rajiv Gandhi Salai, Perungudi, Chennai, Tamil Nadu 600096 Job Description: Proven experience as a Data Engineer (typically 5-10 years, depending on level). Strong hands-on experience with Python for data engineering tasks. Proficiency in SQL (writing complex queries, performance ...

Job Title: Data Engineer (PySpark) ________________________________________ About the Role We are seeking a highly skilled Data Engineer with deep expertise in PySpark and the Cloudera Data Platform (CDP) to join our data engineering team. As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines that ensure high data quality and availability across the organization. This role requires a strong background in big data ecosystems, cloud-native tools, and advanced data processing techniques. The ideal candidate has hands-on experience with data ingestion, transformation, and optimization on the Cloudera Data Platform, along with a proven trac...

Work with Us. Change the World. At AECOM, we're delivering a better world. Whether improving your commute, keeping the lights on, providing access to clean water, or transforming skylines, our work helps people and communities thrive. We are the world's trusted infrastructure consulting firm, partnering with clients to solve the world’s most complex challenges and build legacies for future generations. There has never been a better time to be at AECOM. With accelerating infrastructure investment worldwide, our services are in great demand. We invite you to bring your bold ideas and big dreams and become part of a global team of over 50,000 planners, designers, engineers, scientists, digital ...

About Hero Vired: Would you like to be part of an exciting, innovative, and high-growth startup from one of the largest and most well-respected business houses in the country - the Hero Group? Hero Vired is a premium learning experience offering industry-relevant programs and world-class partnerships, to create the change-makers of tomorrow. At Hero Vired, we believe everyone is made of big things. With the experience, knowledge, and expertise of the Hero Group, Hero Vired is on a mission to change the way we learn. Hero Vired aims to give learners the knowledge, skills, and expertise through deeply engaged and holistic experiences, closely mapped with industry to empower them to transform t...

Position Requirements: ● Minimum 4+ years of experience on PostgreSQL or any Unix based relational database. Advanced understanding of SQL. ● Minimum 2+ years’ experience with Pentaho Data Integration Tools or any ETL/ELT tools like Talend, Informatica, or HOP. ● 2+ years of hands-on experience with orchestration tools (Airflow, Control-M, Autosys). ● Hands-on experience in Python scripting for automation and data processing (1+ years). ● Proven experience with cloud/data platforms (Snowflake, Redshift, BigQuery) and big data (Hadoop, Hive, Spark) is good to have. ● Strong knowledge of data architecture (dimensional modeling, pipelines, warehousing). ● Experience collaborating with non-techn...

Job Description The Oracle Cloud Infrastructure (OCI) team offers a unique opportunity to design, build, and operate a comprehensive suite of large-scale, integrated cloud services within a broadly distributed, multi-tenant cloud environment. With a commitment to delivering exceptional cloud products, OCI empowers customers to tackle some of the world's most pressing challenges, providing tailored solutions that meet their evolving needs. Are you passionate about designing and building large-scale distributed monitoring and analytics solutions for the cloud? Do you thrive in environments that combine the agility and innovation of a startup with the resources and stability of a Fortune 100 co...

Company Overview Milestone Technologies is a global IT managed services firm that partners with organizations to scale their technology, infrastructure and services to drive specific business outcomes such as digital transformation, innovation, and operational agility. Milestone is focused on building an employee-first, performance-based culture and for over 25 years, we have a demonstrated history of supporting category-defining enterprise clients that are growing ahead of the market. The company specializes in providing solutions across Application Services and Consulting, Digital Product Engineering, Digital Workplace Services, Private Cloud Services, AI/Automation, and ServiceNow. Milest...

HVAC Foreman Commissioning | UAE Are you a hands-on professional with a passion for precision and performance? Join us in delivering high-quality MEP systems for landmark projects in the UAE. This role is based on-site in the UAE and will require relocation. ALEMCO is scheduled to hold interviews in India. (Hyderabad, Pune, Mumbai & Bangalore) Who we are! ALEC Engineering and Contracting L.L.C. (ALEC), part of ICD, is a leading GCC construction company known for delivering complex, high-profile projects. With 20+ years of experience, ALEC builds across sectors including airports, hospitality, retail, and high-rises In the UAE, ALEC has delivered many of the nation’s most iconic developments,...

About Us: We are a Data and Analytics Consulting organization that leverages the modern practices of descriptive, predictive, and prescriptive analytics to extract value from business data. Our mission is to help forward-thinking organizations translate their data into actionable insights through analytics to achieve better business outcomes. Whether you need to visualize your financial data, analyze your customer’s journey or behavior, evaluate your marketing campaign performance, quantify risk in your business process, or enhance audit quality through deeper insights, our data analytics expertise can help.. Role: Data Engineer (Snowflake & DBT) Experience: 3 - 5 Years Budget: 12 -15 LPA Lo...

HVAC Foreman Commissioning | UAE Are you a hands-on professional with a passion for precision and performance? Join us in delivering high-quality MEP systems for landmark projects in the UAE. This role is based on-site in the UAE and will require relocation. ALEMCO is scheduled to hold interviews in India. (Hyderabad, Pune, Mumbai & Bangalore) Who we are! ALEC Engineering and Contracting L.L.C. (ALEC), part of ICD, is a leading GCC construction company known for delivering complex, high-profile projects. With 20+ years of experience, ALEC builds across sectors including airports, hospitality, retail, and high-rises In the UAE, ALEC has delivered many of the nation’s most iconic developments,...

Databricks Engineer Job Description Role Overview The Data Engineer will be responsible for designing, building, and optimizing data pipelines and platforms to enable advanced analytics and business intelligence across the organization. This role requires strong expertise in Databricks , SQL , AWS , and Airflow , combined with a solid foundation in data analysis and engineering best practices. The ideal candidate will collaborate with cross-functional stakeholders and ensure scalable, secure, and high-performing data solutions. Location: Bengaluru Key Responsibilities Technical Design Develop, and maintain data pipelines and ETL workflows using Databricks and Airflow. Good understanding of D...

HVAC Foreman Commissioning | UAE Are you a hands-on professional with a passion for precision and performance? Join us in delivering high-quality MEP systems for landmark projects in the UAE. This role is based on-site in the UAE and will require relocation. ALEMCO is scheduled to hold interviews in India. (Hyderabad, Pune, Mumbai & Bangalore) Who we are! ALEC Engineering and Contracting L.L.C. (ALEC), part of ICD, is a leading GCC construction company known for delivering complex, high-profile projects. With 20+ years of experience, ALEC builds across sectors including airports, hospitality, retail, and high-rises In the UAE, ALEC has delivered many of the nation’s most iconic developments,...

MEP Commissioning Foreman - UAE Are you a hands-on professional with a passion for precision and performance? Join us in delivering high-quality MEP systems for landmark projects in the UAE. This role is based on-site in the UAE and will require relocation. ALEMCO is scheduled to hold interviews in India. (Hyderabad, Pune, Mumbai & Bangalore) Who we are! ALEC Engineering and Contracting L.L.C. (ALEC), part of ICD, is a leading GCC construction company known for delivering complex, high-profile projects. With 20+ years of experience, ALEC builds across sectors including airports, hospitality, retail, and high-rises In the UAE, ALEC has delivered many of the nation’s most iconic developments, ...

MEP Commissioning Foreman - UAE Are you a hands-on professional with a passion for precision and performance? Join us in delivering high-quality MEP systems for landmark projects in the UAE. This role is based on-site in the UAE and will require relocation. ALEMCO is scheduled to hold interviews in India. (Hyderabad, Pune, Mumbai & Bangalore) Who we are! ALEC Engineering and Contracting L.L.C. (ALEC), part of ICD, is a leading GCC construction company known for delivering complex, high-profile projects. With 20+ years of experience, ALEC builds across sectors including airports, hospitality, retail, and high-rises In the UAE, ALEC has delivered many of the nation’s most iconic developments, ...

Responsibilities: * Develop data models using Dimensional Data Modeling principles. * Design, build, and maintain Snowflake databases with Snowsql and ELT processes.

Airbnb was born in 2007 when two hosts welcomed three guests to their San Francisco home, and has since grown to over 5 million hosts who have welcomed over 2 billion guest arrivals in almost every country across the globe. Every day, hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way. The Community You Will Join The Payments team at Airbnb is crucial to the company's operations, handling critical data related to compliance with Tax, Payments, and Legal regulations. We also manage application data for tools such as CRM, Jira, and Workday, which are essential for Airbnb’s business. Joining this team means working with ...

MEP Commissioning Foreman - UAE Are you a hands-on professional with a passion for precision and performance? Join us in delivering high-quality MEP systems for landmark projects in the UAE. This role is based on-site in the UAE and will require relocation. ALEMCO is scheduled to hold interviews in India. (Hyderabad, Pune, Mumbai & Bangalore) Who we are! ALEC Engineering and Contracting L.L.C. (ALEC), part of ICD, is a leading GCC construction company known for delivering complex, high-profile projects. With 20+ years of experience, ALEC builds across sectors including airports, hospitality, retail, and high-rises In the UAE, ALEC has delivered many of the nation’s most iconic developments, ...

MEP Commissioning Foreman - UAE Are you a hands-on professional with a passion for precision and performance? Join us in delivering high-quality MEP systems for landmark projects in the UAE. This role is based on-site in the UAE and will require relocation. ALEMCO is scheduled to hold interviews in India. (Hyderabad, Pune, Mumbai & Bangalore) Who we are! ALEC Engineering and Contracting L.L.C. (ALEC), part of ICD, is a leading GCC construction company known for delivering complex, high-profile projects. With 20+ years of experience, ALEC builds across sectors including airports, hospitality, retail, and high-rises In the UAE, ALEC has delivered many of the nation’s most iconic developments, ...

What you will do In this vital role We are looking for a creative and technically skilled Sr Software Engineer to help design and build cutting-edge AI-powered solutions for the pharmaceutical industry. In this role, you''ll develop intelligent systems that surface the most relevant insights from clinical trials, scientific literature, regulatory documents, and internal knowledge assets. Your work will empower researchers, clinicians, and decision-makers with faster, smarter access to the right information. Design and implement search algorithms using NLP, machine learning, semantic understanding, and deep learning models Build and fine-tune models for information retrieval, query expansion,...