15348 Airflow Jobs - Page 30

Seeking Senior Product & Platform Specialist (9+ yrs) with expertise in GCP, BigQuery, PySpark, Python, SQL, and Agile. Lead data platform initiatives, drive innovation, ensure quality, and deliver scalable cloud solutions. Certifications preferred. Required Candidate profile Senior Product & Platform Specialist with 9+ yrs in GCP, BigQuery, PySpark & Python. Expert in data platforms, SQL, and Agile delivery. Strong leader driving innovation and cloud transformation.

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. Role Overview We are looking for a motivated and detail-oriented AI Engineer to join our team, focusing on MLOps practices and Generative AI applications. This role is ideal for early-career professionals who are passionate about building scalable AI pipelines, deploying models in production, and exploring cutting-edge GenAI technologies. Key...

About We are looking for a skilled Data Engineer with a strong background in PostgreSQL, SQL, and Python to join our dynamic team in Kochi. The ideal candidate will be responsible for building and optimising data pipelines, ensuring seamless data flow across systems, and supporting our analytics and product teams with reliable data solutions. What you will do Design, develop, and maintain robust ETL/ELT data pipelines using tools such as Airflow or dbt. Optimize PostgreSQL performance through query tuning, partitioning, indexing, JSONB handling, and PL/pgSQL scripting. Develop efficient SQL and Python scripts for data transformation, automation, and workflow orchestration. Work with Big Data...

Data Engineer Job Description About Sirius AI Sirius AI is a US headquartered AI Consulting services and products company with operations in India. Sirius AI focuses on Financial Services enterprises and solutions / services delivered across multiple geographies. We are an innovation-driven AI and data driven consulting services firm with a high focus on delivering business outcomes for our clients. The Sirius AI team is a mix of talent from a diverse background of Consulting, Industry and Product companies which bring together their Data, Platform, Ecosystem, Technology, Project management and AI skills to develop new solutions and deliver client engagements. Key Responsibilities: • Data Ar...

Job Description Associate Manager, Scientific Data Cloud Engineering The Opportunity Based in Hyderabad, join a global healthcare biopharma company and be part of a 130- year legacy of success backed by ethical integrity, forward momentum, and an inspiring mission to achieve new milestones in global healthcare. Be part of an organisation driven by digital technology and data-backed approaches that support a diversified portfolio of prescription medicines, vaccines, and animal health products. Drive innovation and execution excellence. Be a part of a team with passion for using data, analytics, and insights to drive decision-making, and which creates custom software, allowing us to tackle som...

Job Title: Data Lead / Data Architect – Wealth Management Location: [Noida/Gurgaon/Remote] Experience: 10+ years Must Have: Wealth Management Domain Job Summary: We are seeking a highly skilled Data Lead / Data Architect with deep expertise in the Wealth Management domain to design, implement, and manage scalable data solutions. Experience in building end-to-end Data Lake and Modern Data Platform programs covering the full lifecycle from data ingestion (Bronze Layer) to curation and transformation (Silver Layer), and finally business-ready consumption (Gold Layer) for analytics, AI, and reporting. Work spans across greenfield builds, modernization, re-platforming, and AI/GenAI integrations. ...

Role Purpose The Senior Data & Analytics Architect will play a pivotal role in designing and delivering enterprise-grade data solutions across global markets. This role requires in-depth technical expertise in cloud-native platforms—particularly Databricks—alongside a strategic consulting mindset. The lead will lead cross-functional teams, drive innovation, and ensure data platforms are scalable, secure, and aligned with business goals fro Global enterprises. The person should be hands-on with the Databricks platform, Azure Data Factory, and with a good understanding of platform engineering and operations also. Key Responsibilities 1. Architecture & Solution Design Lead the design and implem...

Responsibilities: Only 6+ allowed Design, develop & maintain ETL processes using AWS Glue, lambda, Python & SQL Optimize performance with Airflow workflows or Step Functions Sound knowledge on Python, spark & optimisation techniques Knowledge of Redshift Office cab/shuttle

Key Responsibilities AI Model Deployment & Integration: Deploy and manage AI/ML models, including traditional machine learning and GenAI solutions (e.g., LLMs, RAG systems). Implement automated CI/CD pipelines for seamless deployment and scaling of AI models. Ensure efficient model integration into existing enterprise applications and workflows in collaboration with AI Engineers. Optimize AI infrastructure for performance and cost efficiency in cloud environments (AWS, Azure, GCP). Monitoring & Performance Management: Develop and implement monitoring solutions to track model performance, latency, drift, and cost metrics. Set up alerts and automated workflows to manage performance degradation...

Role & responsibilities We are looking for a Data Engineer with strong skills in AWS and data engineering tools to support and monitor our data pipelines and systems. The candidate will be responsible for monitoring, troubleshooting, and ensuring smooth execution of ETL/ELT workflows. Key Responsibilities Monitor and maintain AWS services like Redshift, S3, RDS, CloudWatch, AppFlow, EMR, Glue, and DMS. Monitor, schedule, and troubleshoot data workflows in Airflow. Ensure smooth execution of ETL/ELT jobs. Work with SQL and Python for data validation and troubleshooting. Raise alerts and coordinate with teams in case of failures. Required Skills Hands-on experience with AWS (Redshift, S3, RDS,...

Automate ML pipelines, deploy and monitor ML/LLM models, integrate code into customer pipelines, manage CI/CD workflows, containerize applications, set up data pipelines, collaborate with architects, and ensure smooth model deployment at scale. Required Candidate profile Strong MLOps background, hands-on with CI/CD, Docker, Kubernetes, Airflow, MLflow, and LLM tools. Skilled in ML deployment, monitoring, and pipeline automation with ability to coordinate

Our vision is to transform how the world uses information to enrich life for all . Micron Technology is a world leader in innovating memory and storage solutions that accelerate the transformation of information into intelligence, inspiring the world to learn, communicate and advance faster than ever. Micron Consumer Products Group (CPG) is looking for an AI BI Solution Architect to join our team in India. You will be part of a dynamic team and collaborate with cross functional and technical teams. This role will lead the efforts for design and implementation of scalable, secure, and intelligent data and AI solutions. This role bridges the gap between business strategy and technical executio...

Greetings from TCS Human Resources Team!!! Role: Snowflake Developer Exp: 6-12 Years Must have: Snowflake/Python/SQL Location Hyderabad/Pune/Bhubaneshwar Job description Must have 6+ years of IT experience, relevant experience of at least 2 years in Snowflake. In-depth understanding of Data Warehousing, ETL concepts and modeling structure principles Experience working with Snowflake Functions, hands on exp with Snowflake utilities, stage and file upload features, time travel, fail safe,procedure writing,tasks,snowpipe, SnowSQL Knowledge on Snowflake Architecture Good knowledge of Advanced SQL with Joins, Views/Materialized, various Functions, Dimensional Data Modeling and ETL procedures usin...

Design develop maintain data pipelines using Databricks & Apache Spark. ETL data from various sources into the Databricks Optimize data pipelines for performance and scalability Should be Python or Scala, cloud platform Exposure to CI/CD practices

What you will do We are seeking a seasoned Principal Data Engineer to lead the design, development, and implementation of our data strategy. The ideal candidate possesses a deep understanding of data engineering principles, coupled with strong leadership and problem-solving skills. As a Principal Data Engineer, you will architect and oversee the development of robust data platforms, while mentoring and guiding a team of data engineers. Roles & Responsibilities: Possesses strong rapid prototyping skills and can quickly translate concepts into working code. Provide expert guidance and mentorship to the data engineering team, fostering a culture of innovation and standard methodologies. Design,...

What you do We are seeking a seasoned Sr Manager of Data Engineering to drive the development and implementation of our data strategy for Manufacturing and Clinical Supply Chain. The ideal candidate possesses a strong blend of technical expertise and data-driven problem-solving skills. As a Sr. Manager Data Engineering, you will play a crucial role in leading, designing, building, and optimizing our data pipelines and platforms while mentoring junior engineers. Roles & Responsibilities: Contribute to the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions. Take ownership of data pipeline projects from inception to deployment, managing ...

ABOUT THE ROLE Role Description: As the Data Scientist at Amgen, you will be responsible for developing and deploying advanced machine learning, operational research, semantic analysis, and statistical methods to uncover structure in large data sets. This role involves creating analytics solutions to address customer needs and opportunities. Roles & Responsibilities : Accountable to drive full lifecycle of Data Science projects delivery and ability to guide data scientists in shaping the developing the solution and act as a subject matter expert in solving development and commercial questions Assume the role of business owner and manage the Proprietary AI engine built to optimize Copay Suppo...

Role Description: We are looking for a Cloud/Site Reliability Engineer (SRE) to join our AI Platform team, focused on building and maintaining highly available, scalable, and secure infrastructure for AI/ML workloads. This role is critical to ensure the reliability and performance of our AI services and platform components across cloud environments. You will work closely with software engineers, ML engineers, and platform architects to design and implement robust monitoring, alerting, and incident response systems. Youll also contribute to automation of infrastructure provisioning, deployment pipelines, and performance tuning of AI workloads in production. Roles & Responsibilities: Design an...

Role Overview: As the owner of the vision, roadmap, and delivery of enterprise-grade data platforms and BI experiences, your main goal is to transform fragmented data into reliable, governed, and actionable products that enhance decision-making and time-to-insight across the enterprise. Key Responsibilities: - Define Vision & Roadmap: - Develop a problem-first roadmap for lakehouse, semantic layer, and BI experiences in alignment with priority business journeys & projects. - Prioritize domains based on value hypotheses (revenue, cost, risk) and ROI models. - UAT first development: - Collaborate with stakeholders to map source systems, data contracts, golden records, and reporting needs. - Cr...

We’re hiring an experienced Data Engineer to design and build modern data pipelines that power advanced analytics, AI, and healthcare insights. If you thrive in cloud-native environments and love transforming complex, multi-source data into meaningful intelligence — this role is for you. ⚙️ What You’ll Work On Design and maintain scalable batch and streaming data pipelines using Google Cloud Dataflow, Datastream, and Airbyte Develop and optimize ETL/ELT processes across AWS Postgres, Google FHIR Store, and BigQuery Build unified data models integrating EHR/FHIR, claims, HL7, CRM, and transactional data Implement transformations in dbt/OBT to create curated semantic layers for AI/BI pipelines...

Greetings from TCS Human Resources Team!!! Role: Snowflake Developer Exp: 6-12 Years Must have: Snowflake/Python/SQL Location Hyderabad/Pune/Bhubaneshwar Job description Must have 6+ years of IT experience, relevant experience of at least 2 years in Snowflake. In-depth understanding of Data Warehousing, ETL concepts and modeling structure principles Experience working with Snowflake Functions, hands on exp with Snowflake utilities, stage and file upload features, time travel, fail safe,procedure writing,tasks,snowpipe, SnowSQL Knowledge on Snowflake Architecture Good knowledge of Advanced SQL with Joins, Views/Materialized, various Functions, Dimensional Data Modeling and ETL procedures usin...

About the Role: We are seeking a highly skilled Data Engineer to design, build, and optimize scalable data pipelines and infrastructure. The ideal candidate has a strong background in data architecture, ETL processes, and cloud technologies, with a passion for transforming raw data into actionable insights. Key Responsibilities: Design, develop, and maintain robust, scalable, and efficient data pipelines for collecting, processing, and storing large datasets. Build and manage data infrastructure and data models to support analytics, reporting, and machine learning use cases. Implement ETL/ELT processes to ensure high-quality, reliable, and consistent data. Collaborate with cross-functional t...

Job Title: Data, AI & Data Engineering Instructor Location: Mohali Experience Required: 2–3 years Employment Type: Full-Time About the Role We are seeking a highly skilled Data, AI, and Data Engineering Instructor who can train working professionals and collaborate directly with clients to understand their business requirements and deliver customized data-driven solutions. The ideal candidate will have strong hands-on expertise in data science, AI, and data engineering , along with the ability to communicate effectively with corporate teams and adapt content for professional learners. Key Responsibilities Deliver impactful training sessions for corporate professionals on Data Science, Machin...

Big Data Engineer Location: Pune/Nagpur (WFO) Experience Required: 8+ Years **Long term onsite to Abu Dhabi** Job Summary : We are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high performance and reliability. Key Responsibilities: • Design, develop, and maintain data pipelines using PySpark and related Big Data technologies. • Work with HDFS, Hive, Sqoop, and other tools in the Hadoop ecosystem. • Write efficient HiveQL and SQL queries to handle large-scale datasets. • Perform performance tuning and optimization of...

What you will do In this vital role you will as a Senior Associate IS Business Systems Analyst with strong data science and analytics expertise to join the Digital Workplace Experience (DWX) Automation & Analytics product team. In this role, you will develop, maintain, and optimize machine learning models, forecasting tools, and operational dashboards that support strategic and day-to-day decisions for global digital workplace services. This role is ideal for candidates with hands-on experience building predictive models and working with large operational datasets to uncover insights and deliver automation solutions. You will work alongside product owners, engineers, and service leads to del...