15348 Airflow Jobs - Page 34

Associate Software Engineer Live What you will do In this vital role We are looking for a creative and technically skilled Associate Software Engineer to help design and build cutting-edge AI-powered solutions for the pharmaceutical industry. In this role, you'll develop intelligent systems that surface the most relevant insights from clinical trials, scientific literature, regulatory documents, and internal knowledge assets. Your work will empower researchers, clinicians, and decision-makers with faster, smarter access to the right information. . Design and implement search algorithms using NLP, machine learning, semantic understanding, and deep learning models Build and fine-tune models fo...

Were Hiring: Artificial Intelligence Specialist Immediate Joiners Location: Chennai, Sholinganallur, Elcot SEZ 600119 Job Type: Full-time | Permanent Experience: 5+ years in enterprise software & AI/LLM integration About the Role: Are you passionate about AI, LLMs, and Generative AI ? We are looking for a solution-oriented AI Specialist to transform business operations with innovative AI solutions. This is not a traditional ML engineering role —we are seeking someone who can strategically integrate AI capabilities into enterprise systems and deliver real business impact . Immediate joiners welcome! Key Responsibilities: AI Solution Strategy & Innovation Identify opportunities where AI/LLM in...

Entity :- Accenture Strategy & Consulting Team :- Strategy & Consulting Global Network Practice :- Marketing Analytics Title :- Consultant/ Manager/Analyst Marketing & Customer Data Platforms (GCP, CDP, Agentic AI) Job location :- Any out of 6 AI locations About S&C - Global Network (GN) :- Accenture GN's Data & AI (AI Hub India) practice help our clients grow their business in entirely new ways. Analytics enables our clients to achieve high performance through insights from data - insights that inform better decisions and strengthen customer relationships. From strategy to execution, Accenture works with organizations to develop analytic capabilities - from accessing and reporting on data t...

Entity :- Accenture Strategy & Consulting Team :- Strategy & Consulting Global Network Practice :- Marketing Analytics Title :- Consultant/ Manager/Analyst Marketing & Customer Data Platforms (GCP, CDP, Agentic AI) Job location :- Any out of 6 AI locations About S&C - Global Network (GN) :- Accenture GN's Data & AI (AI Hub India) practice help our clients grow their business in entirely new ways. Analytics enables our clients to achieve high performance through insights from data - insights that inform better decisions and strengthen customer relationships. From strategy to execution, Accenture works with organizations to develop analytic capabilities - from accessing and reporting on data t...

We are seeking a DevOps Engineer to design, implement, and manage scalable cloud infrastructure and CI/CD pipelines for Data and Machine Learning platforms . The ideal candidate will have good experience with AWS Cloud , Terraform , and automation frameworks supporting end-to-end ML lifecycle operations. Key Responsibilities Design and implementation of DevOps solutions for Data and ML workloads. Build and maintain CI/CD pipelines for data ingestion, model training, and deployment. Manage and optimize AWS cloud infrastructure ensuring scalability, security, and cost efficiency. Automate infrastructure provisioning and configuration using Terraform or similar IaC tools. Collaborate closely wi...

Job Description YOU’LL BUILD TECH THAT EMPOWERS GLOBAL BUSINESSES Our Connect Technology teams are working on our new Connect platform, a unified, global, open data ecosystem powered by Microsoft Azure. Our clients around the world rely on Connect data and insights to innovate and grow. As a Senior Data Engineer, you’ll be part of a team of smart, highly skilled technologists who are passionate about learning and supporting cutting-edge technologies such as Spark, Scala, Pyspark, Databricks, Airflow, SQL, Docker, Kubernetes, and other Data engineering tools. These technologies are deployed using DevOps pipelines leveraging Azure, Kubernetes, Jenkins and Bitbucket/GIT Hub. WHAT YOU’LL DO: Dev...

We are seeking a DevOps Engineer to design, implement, and manage scalable cloud infrastructure and CI/CD pipelines for Data and Machine Learning platforms . The ideal candidate will have good experience with AWS Cloud , Terraform , and automation frameworks supporting end-to-end ML lifecycle operations. Key Responsibilities Design and implementation of DevOps solutions for Data and ML workloads. Build and maintain CI/CD pipelines for data ingestion, model training, and deployment. Manage and optimize AWS cloud infrastructure ensuring scalability, security, and cost efficiency. Automate infrastructure provisioning and configuration using Terraform or similar IaC tools. Collaborate closely wi...

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. Job Description – Snowflake Data Engineer Objectives and Purpose The Senior Data Engineer ingests, builds, and supports large-scale data architectures that serve multiple downstream systems and business users. This individual supports the Data Engineer Leads and partners with Visualization on data quality and troubleshooting needs. The Senior...

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. EY GDS – Data and Analytics (D&A) – Snowflake Data Engineer- Senior We’re looking for candidates with strong technology and data understanding in data engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team Your key responsibiliti...

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. Job Description – Snowflake Data Engineer Objectives and Purpose The Senior Data Engineer ingests, builds, and supports large-scale data architectures that serve multiple downstream systems and business users. This individual supports the Data Engineer Leads and partners with Visualization on data quality and troubleshooting needs. The Senior...

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. EY GDS – Data and Analytics (D&A) – Snowflake Data Engineer- Senior We’re looking for candidates with strong technology and data understanding in data engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team Your key responsibiliti...

Job Description You enjoy shaping the future of product innovation as a core leader, driving value for customers, guiding successful product launches, and exceeding expectations. Join our dynamic team and make a meaningful impact by delivering high-quality products that resonate with clients. As a Product Manager in the Consumer and Community Banking - Data Publishing and Processing (DPP) team, you are an integral part of the group that innovates in building data publishing and processing products and leads the end-to-end product life cycle. As a core leader, you are responsible for acting as the voice of the customer and developing DPP products that provide customer value. Utilizing your de...

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. Job Description – Snowflake Data Engineer Objectives and Purpose The Senior Data Engineer ingests, builds, and supports large-scale data architectures that serve multiple downstream systems and business users. This individual supports the Data Engineer Leads and partners with Visualization on data quality and troubleshooting needs. The Senior...

At EY, you’ll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we’re counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. EY GDS – Data and Analytics (D&A) – Snowflake Data Engineer- Senior We’re looking for candidates with strong technology and data understanding in data engineering space, having proven delivery capability. This is a fantastic opportunity to be part of a leading firm as well as a part of a growing Data and Analytics team Your key responsibiliti...

Job Description Vertiv is looking for a Data Engineer to build and manage the data infrastructure that powers our smart manufacturing and IoT initiatives for the switchgear and busway business. This position will lead the design, development, and deployment of scalable data pipelines, sourcing mission-critical data from our global network of manufacturing sites and IoT-enabled products. You will be responsible for creating a unified, reliable data foundation that enables advanced analytics, machine learning, and business intelligence to drive operational excellence and innovation across Vertiv. Responsibilities Programming & Scripting: Python (Pandas, NumPy, Scikit-learn, PyTorch, TensorFlow...

Job Description Vertiv is looking for a Data Engineer to build and manage the data infrastructure that powers our smart manufacturing and IoT initiatives for the switchgear and busway business. This position will lead the design, development, and deployment of scalable data pipelines, sourcing mission-critical data from our global network of manufacturing sites and IoT-enabled products. You will be responsible for creating a unified, reliable data foundation that enables advanced analytics, machine learning, and business intelligence to drive operational excellence and innovation across Vertiv. Responsibilities Programming & Scripting: Python (Pandas, NumPy, Scikit-learn, PyTorch, TensorFlow...

Job Title: Data Engineer III Location: Delhi (Hybrid) Department: Data Engineering Reports To: Engineering Manager – Data Platform About the Role The Data Engineer III will lead the design and optimization of Baazi’s large-scale data platform. You’ll architect end-to-end data solutions, mentor junior engineers, and drive innovation across our AWS-based data ecosystem to enable faster, smarter insights across products. Key Responsibilities Architect, build, and optimize large-scale data pipelines and lakehouse systems using Iceberg or Hudi. Design and implement advanced ETL/ELT frameworks in AWS (Glue, EMR, Redshift, Lambda). Lead development of reusable, modular data pipeline components usin...

Skills: Proficiency in SQL is a must. PL/SQL to understand integration SP part. Experience in PostgreSQL is must. Basic knowledge of Google Cloud Composer ( or Apache Airflow). Composer is managed GCP service for Apache Airflow. All pipelines are orchestrated and scheduled through Composer GCP basics-high level understanding of using GCP UI and services like Cloud SQL PostgreSQL Cloud Composer Cloud Storage Dataproc Airlfow DAGs are written in Python basic knowledge of Python code for DAGs Dataproc is Managed Spark in GCP so a bit of PySpark knowledge is also nice to have.

Description: Key job responsibilities include, but are not limited to Become involved with day-to-day operations in Production Control. Understand the workflows and be able to troubleshoot issues and define new workflows in PCS and Control-M Design Airflow infrastructure according to the industry best practices. Work with System Administrators, Platform Engineers, Network, Firewall and Monitoring teams on the implementation of the infrastructure. Document the system's specifics, define, and implement administrative controls and policies of Airflow. Work with the development teams to identify the groups of jobs to migrate to airflow. Assist the development teams with the migrations:define DAG...

Data Engineer-29064 Position:FTE, remote, IndiaAvailability-Immediate-1 weekMax rate:28-30 LPAOverlap:4 hours with PST(Pacific Standard Time)Candidate proficiency level:Senior(8+)Requirements:Bachelor's degree or higher in Computer Science, Engineering, or a related field.5+ years of experience in data engineering, with a strong focus on designing and building data pipelines and infrastructure.Proficient in SQL and Python, with the ability to translate complexity into efficient code.Experience with data workflow development and management tools (dbt, Airflow).Solid understanding of distributed computing principles and experience with cloud-based data platforms such as AWS, GCP, or Azure.Stro...

Python +SQL developer Python Data Integration Engineer Role and Responsibilities:As the Data Integration Engineer, you will play a pivotal role in shaping the future of our data integration engineering initiatives. You will remain actively involved in the technical aspects of the projects. Your responsibilities will include:Hands-On Contribution:Continue to be hands-on with data integration engineering tasks, including data pipeline development, EL processes, and data integration. Be the go-to expert for complex technical challenges. Integrations Architecture:Design and implement scalable and efficient data integration architectures that meet business requirements. Ensure data integrity, qua...

Python Developer Exp- 5-9yrs Max salary 25lpa-28lpa Pune and Hyd (Hybrid -WFO) Fixed rate - FTE Python Data Integration Engineer :Are you a seasoned data engineer with a passion for both hands-on technical work? Do you thrive in an environment that values innovation, collaboration, and cutting-edge technologies? We are seeking an experienced Data Integration engineer to spearhead our data integration strategies and initiatives. The ideal candidate will possess deep technical expertise in Python programming, Snowflake data warehousing, AWS cloud services, Kubernetes (EKS), CI/CD methodologies, Apache Airflow, dbt, Kafka for real-time data streaming, and API development. This role is pivotal i...

We are looking for a passionate and detail-oriented Software Engineer to join our Big Data / Data Warehouse (DWH) / ETL team. The ideal candidate should have a strong understanding of data systems, data processing pipelines, and an interest in large-scale data analytics. Fresh graduates with relevant academic projects or training in data engineering are also welcome to apply. Responsibilities Design, develop, and maintain ETL pipelines for efficient data extraction, transformation, and loading. Work with Big Data technologies (Hadoop, Spark, Hive, etc. ) to process and analyse large datasets. Develop and maintain data warehouse models and ensure data integrity and consistency. Optimise and t...

GCP Data Engineer Primary Skill : Big Querry, Data flow, Data Composer, SQL, Python, Pyspark Proven experience as a Data Engineer with a focus on GCP services. Strong proficiency in GCP services such as Dataflow, BigQuery, and Pub/Sub. Hands-on experience with Terraform for provisioning and managing GCP infrastructure. Proficiency in Pyspark, SQL and Python for data manipulation and analysis. Solid understanding of data warehousing concepts and ETL processes. Experience with real-time data processing and streaming analytics. Strong problem-solving skills and attention to detail. Excellent communication and collaboration skills.

Strong understating of Python, ML concepts and frameworks, Fast API, Graph QL Experience in developing scalable APIs. Knowledge of AWS, preferred services are storage, EC2, Kubernetes Exposure of ML best practices, documentation and unit testing. ML Flow, AirFlow, ML pipeline creation, drift monitoring and control Experience in developing and deploying machine learning models in a production environment using CI/CD. Communicate with clients to understand requirements and ask right questions. Knowledge of Django and database design will be added advantage. Strong analytical and problem-solving skills. Experience in proprietary and public LLMs, including finetuning, inference optimization Expe...