15348 Airflow Jobs - Page 13

We are seeking a highly skilled and passionate Senior Solution Architect – Generative AI to join our team and lead the design and implementation of cutting-edge AI solutions. This role is ideal for a seasoned professional with extensive experience in AI/ML development and architecture, a deep understanding of generative AI technologies, and a strategic mindset to align innovations with business requirements. Responsibilities Develop and oversee architectural designs for generative AI models, frameworks, and solutions tailored to business needs Design scalable pipelines for integrating and deploying generative AI solutions in alignment with enterprise architecture Perform in-depth research to...

Required Skills: 3- 6 years of relevant experience in data engineering, data analytics, or BI development. Proven hands-on experience with Google BigQuery and GCP data services (e.g., Cloud Storage, Cloud Functions, Dataflow optional). Strong expertise in SQL , including analytical functions, joins, CTEs, and window functions. Basic to intermediate knowledge of Python for scripting and automation. Understanding of data warehouse concepts , data modeling, and normalization. Familiarity with version control systems like Git.

Duties & Responsibilities Design, develop, and maintain scalable ETL/ELT data pipelines to support business and analytics needs Write, tune, and optimize complex SQL queries for data transformation, aggregation, and analysis Translate business requirements into well-designed, documented, and reusable data solutions Partner with analysts, data scientists, and stakeholders to deliver accurate, timely, and trusted datasets Automate data workflows using orchestration/scheduling tools (Airflow, ADF, Luigi, etc.) Develop unit tests, integration tests, and validation checks to ensure data accuracy and pipeline reliability Document pipelines, workflows, and design decisions for knowledge sharing and...

Key Responsibilities Data Integration & Extraction Develop and maintain ETL/ELT pipelines using Airbyte and Airflow. Extract data from multiple sources including APIs, direct database connections, and flat files. Ensure data quality, consistency, and reliability across all ingestion processes. Data Modeling & Warehousing Design and implement Kimball-style dimensional models in Snowflake. Build and optimize fact tables and dimension tables to support analytical workloads. Collaborate with business teams to define and maintain the BUS Matrix for subject areas . Transformation & Orchestration Use DBT to develop modular, testable, and version-controlled transformations. Implement data quality ch...

We are seeking a highly skilled and passionate Senior Solution Architect – Generative AI to join our team and lead the design and implementation of cutting-edge AI solutions. This role is ideal for a seasoned professional with extensive experience in AI/ML development and architecture, a deep understanding of generative AI technologies, and a strategic mindset to align innovations with business requirements. Responsibilities Develop and oversee architectural designs for generative AI models, frameworks, and solutions tailored to business needs Design scalable pipelines for integrating and deploying generative AI solutions in alignment with enterprise architecture Perform in-depth research to...

Job Title: Foreman & Chargehand – HVAC & Ducting Location: Dubai, UAE Industry: Construction / MEP Company: Reputed MEP Contracting Company Job Type: Full-Time Job Summary The Foreman & Chargehand – HVAC & Ducting will oversee, coordinate, and execute all HVAC installation and ducting works at the project site. The role requires strong technical skills, manpower supervision, quality control, and the ability to deliver work as per approved drawings, project schedules, and safety compliance. Key Responsibilities HVAC & Ducting Installation Supervise and execute installation of HVAC systems, including ducting, GI/PI ducts, chilled water piping, FCUs, AHUs, and exhaust systems. Ensure duct fabri...

Summary As a Software Architect, this role requires specialized depth and breadth of expertise in software architecture. The ideal candidate will interpret internal and external business issues to recommend best practices and solve complex problems. They will take a broad perspective to identify innovative solutions and work independently, receiving guidance only in the most complex situations. Additionally, the candidate may lead functional teams or projects, demonstrating strong leadership and collaboration skills. Responsibilities: As a seasoned Software Architect, you will be responsible for designing, implementing & deploying scalable, reliable, and maintainable software solutions. Lead...

Experience: 5+ Years Location: Hyderabad /Hybrid Employment Type: Full-time About ServCrust ServCrust is a fast-growing D2C SaaS platform reshaping the construction materials and logistics ecosystem using AI-led supply chain intelligence, geo-analytics, and credit-risk insights . We process real-time order, logistics, and IoT data across multiple states to deliver insights on pricing, supplier performance, delivery optimization, and more Role Overview We’re looking for an experienced Data Engineer to build and scale our end-to-end data pipelines that power dashboards, AI models, and decision systems across our microservices-driven architecture. You’ll collaborate closely with Data Science, P...

We are seeking a Junior Data Engineer who is enthusiastic about working with data, quick to learn new technologies, and ready to take on challenges in a collaborative environment. If you’re a team player with a positive attitude and a drive to grow, we encourage you to apply! Roles And Responsibilities Assist in building and maintaining data ingestion, processing, and analytical pipelines using AWS services (ETL/ELT preferred) Support the design of data models for performance and reliability Work with big data, relational databases, NoSQL, and data warehouse solutions under guidance Collaborate with senior engineers on developing, monitoring, and maintaining data pipelines Handle moderate da...

Loc: Manyata Tech Park Exp: 2-5 yrs, AI/ML Engineer Skills Required: ? Exp. with Data engineering & Data/ML pipelines for Analytics & AI/ML Models ? Working with large sets of structured & unstructured data from disparate sources ? Foundational acquaintance of Data Science & AI/ML models ? SQL, Python, Spark, PySpark ? Big Data systems - Hadoop Ecosystem (HDFS, Hive, MapReduce) ? Analytics database like Druid, Data visualization/exploration tools like Superset ? Understanding of cloud platforms (AWS, Azure, or GCP) ? GIT Secondary Skills (desired/preferred): ? Apache Airflow, Apache Oozie, Nifi ? GCP cloud exp, Big Query, GCP Big Data Ecosystem ? Trino/Presto ? Familiar with forecasting algo...

Job Title: Foreman & Chargehand – HVAC & Ducting Location: Dubai, UAE Industry: Construction / MEP Company: Reputed MEP Contracting Company Job Type: Full-Time Job Summary The Foreman & Chargehand – HVAC & Ducting will oversee, coordinate, and execute all HVAC installation and ducting works at the project site. The role requires strong technical skills, manpower supervision, quality control, and the ability to deliver work as per approved drawings, project schedules, and safety compliance. Key Responsibilities HVAC & Ducting Installation Supervise and execute installation of HVAC systems, including ducting, GI/PI ducts, chilled water piping, FCUs, AHUs, and exhaust systems. Ensure duct fabri...

What you'll do The Enterprise Architecture team is focused on providing solutions to enable an effective software engineering workforce that can scale to the business needs. This includes exploring how the business needs map to the application portfolio, business processes, APIs, and data elements across the organization. As a member of this team, you will build up a vast knowledge in software development, cloud application engineering, automation, and container orchestration. Our ideal candidate values communication, learning, adaptability, creativity, and ingenuity. They also enjoy working on challenging technical issues and use creative, innovative techniques to develop and automate solut...

About the Role We are looking for a highly analytical Data Scientist to extract insights from complex datasets and build data-driven solutions that support business decision-making. You will apply statistical methods, machine learning techniques, and analytical models to solve real-world problems. Key Responsibilities Collect, preprocess, and analyze structured and unstructured data. Develop predictive models and machine learning solutions to address business challenges. Perform exploratory data analysis (EDA) to uncover trends and patterns. Build and optimize algorithms for classification, regression, clustering, and forecasting. Create data visualizations and dashboards to clearly communic...

Duties & Responsibilities Translate business requirements into scalable and well-documented AI/ML pipelines using Databricks, Azure AI, and Snowflake. Design and deploy GenAI-powered applications using pretrained models (e.g., GPT-4, LLaMA) for tasks such as text generation, summarization, code synthesis, and personalization. Build and orchestrate agentic AI workflows using frameworks like LangChain, OpenAI Agents SDK, and Databricks Genie, enabling autonomous task execution and multi-agent collaboration. Integrate GenAI models into enterprise applications with Human-in-the-Loop (HITL) validation and feedback loops for production readiness. Conduct model selection, fine-tuning, and evaluatio...

Desired Competency Min 8+ years experience in BigData, Spark and Scala Experience in Hadoop, Pyspark, Hive, Sqoop, Oozie Must have expertise in the use of Good Cloud and SQL/HQL Strong skills in In-memory applications, Database Design Experience writing shell scripts using (ksh, bash, perl or python). Experience in Google Cloud Bigquery, Dataproc and Dataflow Good-to-Have Unix, Shell Scripting, knowledge of commercial databases, Kafka Ability to perform data related benchmarking, performance analysis and tuning Solid understanding of Data Warehousing Concepts. Role & responsibilities Good communications skills to clarify requirements or explain technical designs to non- technical business st...

Greetings from TCS! We are looking for - Data Engineer(Python, Databricks, SQL) Experience: 6-8 years Location: Hyderabad Desired Competencies- Create and maintain optimal data pipeline architecture, Assemble large, complex data sets that meet functional / non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure required for optimal ingestion, transformation, and Publishing of data from a wide variety of data sources using Python/Spark and AWS ‘big data’ technologies. Build analytics tools that utilize the data p...

About The Role Project Role : Data Engineer Project Role Description : Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems. Must have skills : Microsoft Azure Data Services Good to have skills : NA Minimum 3 year(s) of experience is required Educational Qualification : 15 years full time education Summary :As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data qua...

We are united in our mission to make a positive impact on healthcare. Join Us! South Florida Business Journal, Best Places to Work 2024 Inc. 5000 Fastest-Growing Private Companies in America 2024 2024 Black Book Awards, ranked #1 EHR in 11 Specialties 2024 Spring Digital Health Awards, "Web-based Digital Health" category for EMA Health Records (Gold) 2024 Stevie American Business Award (Silver), New Product and Service: Health Technology Solution (Klara) Who we are: We Are Modernizing Medicine (WAMM)! We're a team of bright, passionate, and positive problem-solvers on a mission to place doctors and patients at the center of care through an intelligent, specialty-specific cloud platform. Our ...

Job Description: Trainer Data Engineer & Cloud Data Platform Role Summary We seek a Senior Data Engineer & Technical Trainer to teach modern cloud data engineering with Azure, AWS, GCP, Azure Databricks, Snowflake. Focus on production-grade pipelines, Lakehouse, ELT, CDC, streaming, data modeling, and governance. Key Responsibilities Deliver multi-cloud data engineering training (fundamentals to advanced) Teach batch, streaming, CDC pipelines & Lakehouse architectures Build real-world use cases in Azure, AWS, GCP, Databricks, Snowflake Conduct hands-on labs, code reviews, architecture walkthroughs Guide students on data modeling, orchestration, monitoring, CI/CD Mentor students for interview...

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. How will you make an impact in this role? Responsible for contacting clients with overdue accounts to secure the settlement of the account. Also they do preventive...

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. How will you make an impact in this role? Responsible for contacting clients with overdue accounts to secure the settlement of the account. Also they do preventive...

Visit customer sites to troubleshoot issues and resolve product-related problems. Handle calls related to customer complaints , provide quick solutions, and maintain service quality. Assist the Sales Team with technical queries related to all Omicron products (HVAC, BMS, Sensors, Transmitters, Controllers, etc.). Perform site support and service of sensors, transmitters, controllers, and HVAC and BMS products. Maintain proper records of all repaired transmitters , including serial numbers, issues found, and actions taken. Perform calibration of HVAC instruments and Omicron products such as temperature sensors, humidity sensors, CO₂ sensors, pressure transmitters, airflow devices, etc. Prepar...

Visit customer sites to troubleshoot issues and resolve product-related problems Omicron products (HVAC, BMS, Sensors, Transmitters, Controllers, etc.). Handle calls related to customer complaints , provide quick solutions, and maintain service quality. Assist the Sales Team with technical queries related to all Omicron products (HVAC, BMS, Sensors, Transmitters, Controllers, etc.). Perform site installation, testing, and commissioning of sensors, transmitters, controllers, and HVAC/BMS products. Maintain proper records of all repaired transmitters , including serial numbers, issues found, and actions taken. Perform calibration of HVAC instruments and Omicron products such as temperature sen...

Job Description: We are seeking a talented and motivated Machine Learning Engineer with a focus on Generative AI and MLOps to join our dynamic team. The ideal candidate will design, develop, and deploy machine learning models, leveraging generative AI techniques and operational best practices. You will collaborate closely with data scientists, software engineers, and product teams to deliver scalable AI-driven solutions that enhance business outcomes and customer experiences. Key Responsibilities: Design, build, and optimize machine learning and generative AI models , including model fine-tuning, embedding generation, and evaluation. Develop and maintain MLOps pipelines for model deployment,...

Job Title: HVAC TechnicianJob Summary: The HVAC Technician is responsible for the installation, operation, maintenance, and troubleshooting of Heating, Ventilation, and Air Conditioning (HVAC) systems. The role ensures efficient performance, comfort, and safety across facilities while minimizing downtime. Key Resposibilities: 1. Installation & Commissioning Install HVAC systems including AHUs, FCUs, VRV/VRF units, split ACs, package units, ducting, and ventilation systems. Assist in commissioning, testing, and balancing of HVAC systems. Install electrical controls, thermostats, and sensors as per design. 2. Operation & Monitoring Monitor temperature, humidity, airflow, pressure, and system p...