10863 Airflow Jobs - Page 27

Our technology services client is seeking multiple GCP Data Engineer to join their team on a contract basis. These positions offer a strong potential for conversion to full-time employment upon completion of the initial contract period. Below are further details about the role: Role: GCP Data Engineer Experience: 6- 10 Years Location: Chennai Notice Period: Immediate- 15 Days Mandatory Skills: GCP, Python, Big Query, SQL, Airflow, Data Flow Job Description: Knowledge on Google Cloud Platform Big Query SQL Dataflow with JavaPython Dataproc with PySparkPython Kafka or Pubsub Airflow and Cloud RunCloud function with Python 3 years of GCP experience GCP BQ and Python mandatory Experience on any ...

Open Location - Indore, Noida, Gurgaon, Bangalore, Hyderabad, Pune Immediate Joiners are preferred. Qualification 4 years of good hands-on exposure with Big Data technologies – pySpark (Data frame and SparkSQL), Hadoop, and Hive Good hands-on experience of python and Bash Scripts Good understanding of SQL and data warehouse concepts Strong analytical, problem-solving, data analysis and research skills Demonstrable ability to think outside of the box and not be dependent on readily available tools Excellent communication, presentation and interpersonal skills are a must Hands-on experience with using Cloud Platform provided Big Data technologies Orchestration with Airflow and Any job schedule...

IMEA (India, Middle East, Africa) India LIXIL INDIA PVT LTD Employee Assignment Fully remote possible Full Time 1 May 2025 Title Data Engineer Job Description A Data Engineer is responsible for designing, building, and maintaining large-scale data systems and infrastructure. Their primary goal is to ensure that data is properly collected, stored, processed, and retrieved to support business intelligence, analytics, and data-driven decision-making. Key Responsibilities Design and Develop Data Pipelines: Create data pipelines to extract data from various sources, transform it into a standardized format, and load it into a centralized data repository. Build and Maintain Data Infrastructure: Des...

Hi All, We are hiring for a Permanent role at LTI Mindtree ! Role: GCP Data Engineer Experience: 5+ Years Location: PAN India Notice Period: Immediate to 30 Days 📩 Interested candidates can share their updated CVs at Neha.Ingale@alphacom.in Job Description We are looking for an experienced GCP Data Engineer with strong expertise in Google Cloud Platform services. The ideal candidate should have hands-on experience with GCP data stack components such as BigQuery, DataFlow, DataProc, Cloud Composer, PySpark, and Python. Knowledge of Tableau or MSTR is mandatory. This is a great opportunity to work on innovative data engineering solutions in a fast-paced, collaborative environment. Key Responsi...

Job Title : Snowflake Administrator with DBT Location : Remote Experience Required : 5 7 Years (with minimum 4 years in DBT) Job Summary We are seeking an experienced Snowflake Administrator with strong DBT expertise to join our data engineering team. The ideal candidate will be responsible for administering Snowflake environments, optimizing performance, ensuring data security, and developing DBT models to support business reporting and analytics. Key Responsibilities Administer and manage Snowflake data warehouse environments, including user management, roles, and permissions. Monitor and optimize Snowflake performance, query tuning, and resource usage. Implement data security best practic...

About TechRBM TechRBM is a fast-growing digital transformation partner to global enterprises, delivering solutions across AI, Cloud, Data Engineering, and Automation. We're scaling from 120+ to 300-500 professionals and are building a high-impact Data Science team to ship measurable business outcomes for clients in BFSI, Retail, Healthcare, Manufacturing, and High-Tech. Role Overview We're hiring a Senior Data Scientist who can own end-to-end problem solving-from business discovery and hypothesis design to model deployment and post-production monitoring. You will partner with product, engineering, and client stakeholders to build production-grade ML/AI and GenAI solutions on AWS/Azure/GCP an...

Sr Python Developer (AI/ML Projects) Location : Onsite | Mohali Experience : 6-9 Years Employment Type : Full-Time Role Overview We are looking for a Senior Python Developer with deep expertise in AI/ML frameworks, data engineering, and scalable application development. The candidate will work on high-velocity AI/ML projects-ranging from predictive analytics and recommendation engines to generative AI platforms-where fast delivery and iteration are Responsibilities : Design & Develop : Build robust Python-based applications for AI/ML, data processing, and automation. Model Integration : Implement, fine-tune, and deploy ML/DL models using TensorFlow, PyTorch, Scikit-learn, Hugging Face. Data ...

As an experienced individual in the field of research, design, and development, your role at Aeris Communications Inc. will involve the following key responsibilities: - Research, design, and development of next-generation Applications supporting billions of transactions and data. - Design and development of cloud-based solutions with extensive hands-on experience on Big Data, distributed programming, ETL workflows, and orchestration tools. - Design and development of microservices in Java / J2EE, Node JS, with experience in containerization using Docker, Kubernetes. - Focus on developing cloud-native applications utilizing cloud services. - Collaborate with product managers/owners & interna...

As a seasoned Product Manager at Wayfair, you will accelerate the development of the technology stack, specifically focusing on our Data Ingestion systems. Your role will involve collaborating with various stakeholders in engineering, product, and data science to identify pain points, business KPIs, and technical gaps. By translating business needs into a strategic roadmap, you will drive the development of solutions that enhance customer satisfaction and supplier engagement. **Key Responsibilities:** - Be the subject matter expert and owner of Data Ingestion technologies, managing real-time and batch data processing - Prioritize feature requests based on business value, impact, risks, and d...

About Us About DATAECONOMY: We are a fast-growing data & analytics company headquartered in Dublin with offices inDublin, OH, Providence, RI, and an advanced technology center in Hyderabad,India. We are clearly differentiated in the data & analytics space via our suite of solutions, accelerators, frameworks, and thought leadership. Job Description About the Role We are looking for an experienced Data Architect to lead the design and implementation of scalable, secure, and high-performance data solutions. The ideal candidate will have a strong background in data architecture, cloud platforms, and modern data frameworks, with the ability to guide clients and teams in building next-generation d...

About Us About DATAECONOMY: We are a fast-growing data & analytics company headquartered in Dublin with offices inDublin, OH, Providence, RI, and an advanced technology center in Hyderabad,India. We are clearly differentiated in the data & analytics space via our suite of solutions, accelerators, frameworks, and thought leadership. Job Description About the Role We are looking for an experienced Data Architect to lead the design and implementation of scalable, secure, and high-performance data solutions. The ideal candidate will have a strong background in data architecture, cloud platforms, and modern data frameworks, with the ability to guide clients and teams in building next-generation d...

As a Technical Lead AI, you will be responsible for driving the design, development, and deployment of AI-driven solutions across multiple product lines. You should have a proven track record of supporting AI-embedded products, leading Gen AI initiatives, and establishing best practices in data pipelines, ML model lifecycle, LLMs, and MLOps. Your role will involve collaborating with cross-functional teams to architect scalable AI systems, mentor engineers, and ensure successful integration of AI capabilities into business applications. - Lead the end-to-end design and implementation of AI/ML and GenAI solutions, including Retrieval-Augmented Generation (RAG) pipelines. - Partner with product...

Job Description Where Data Does More. Join the Snowflake team. Our Solutions Engineering organization is seeking a Data Platform Architect to join our Field CTO team who can provide leadership in working with both technical and business executives in the design and architecture of the Snowflake Cloud Data Platform as a critical component of their enterprise data architecture and overall ecosystem. In this role you will work directly with the sales team and channel partners to understand the needs of our customers, strategize on how to navigate winning sales cycles, provide compelling value-based demonstrations, support enterprise Proof of Concepts, and ultimately close business. You will lev...

Where Data Does More. Join the Snowflake team. Our Solutions Engineering organization is seeking a Data Platform Architect to join our Field CTO team who can provide leadership in working with both technical and business executives in the design and architecture of the Snowflake Cloud Data Platform as a critical component of their enterprise data architecture and overall ecosystem. In this role you will work directly with the sales team and channel partners to understand the needs of our customers, strategize on how to navigate winning sales cycles, provide compelling value-based demonstrations, support enterprise Proof of Concepts, and ultimately close business. You will leverage your exper...

Role Overview: At PwC, your role in data and analytics will involve leveraging data to drive insights and make informed business decisions. You will utilize advanced analytics techniques to help clients optimize their operations and achieve their strategic goals. Specifically, in data analysis at PwC, you will focus on utilizing advanced analytical techniques to extract insights from large datasets and drive data-driven decision-making. Your responsibilities will include leveraging skills in data manipulation, visualization, and statistical modeling to support clients in solving complex business problems. Key Responsibilities: - Develop and implement MLOps strategies tailored for Generative ...

As a Data Engineer, You Will Partner with KFC, Pizza Hut, Taco Bell & Habit Burger to identify opportunities to leverage company data to drive business outcomes. Play a key role in our advanced analytics team - developing data-driven solutions, and responsible for driving Yum Growth. Design and develop scalable streaming data integration frameworks to move and transform a variety of data sets. Develop on the Yum! data platform by building applications using a mix of open-source frameworks (Py-Spark, Kubernetes, Airflow, etc.) and best in breed SaaS tools (Informatica Cloud, Snowflake, Domo, etc.). Implement and manage production support processes around data lifecycle, data quality, coding u...

At Yum! We’re looking for a Software Engineer to add to our dynamic and rapid scaling team. We’re making this investment to help us optimize our digital channels and technology innovations with the end goal of creating competitive advantages for our restaurants around the globe. We’re looking for a solid lead engineer who brings fresh ideas from past experiences and is eager to tackle new challenges in our company. We’re in search of a candidate who is knowledgeable about and loves working with modern data integration frameworks, big data, and cloud technologies. Candidates must also be proficient with data programming languages (e.g., Python and SQL). The Yum! data engineer will build a var...

8+ years of Data Engineering experience in a Production cloud infrastructure AWS services - Glue, Redshift, RDS, CloudWatch, CloudFormation, S3, IAM etc. 5+ years experience working in a Big Data ecosystem processing data; includes file systems, data structures/databases, automation, security, messaging, movement, etc. • 6+years in Glue development and 4+ years of experience in development in Python. • Experience in translation of Data mapping documents into PySpark ETL code compatible to be able to run on Glue. • Proficiency in Python and SQL is a must.

Experience: 7+ Years Location: Bangalore Key Responsibilities Design, develop, and maintain scalable ETL pipelines using AWS Glue and PySpark . Lead the data engineering team , ensuring best practices in coding, testing, and deployment. Implement workflow orchestration solutions for complex data pipelines. Optimize data pipelines and queries for advanced SQL performance. Collaborate with data scientists, analysts, and stakeholders to deliver reliable data solutions. Ensure data quality, governance, and security across systems. Drive continuous improvements in ETL processes and architecture. Requirements 7+ years of hands-on experience in Data Engineering . Strong expertise in AWS Glue , ETL ...

Key Responsibilities: Design, develop, and manage scalable, secure, and efficient data pipelines on Google Cloud Platform (GCP) to process and transform large datasets from multiple sources. Implement and optimize GCP data services such as BigQuery, Cloud Storage, Cloud SQL, Dataflow, Dataproc, Pub/Sub, and Cloud Functions. Architect and maintain ETL/ELT processes to ensure efficient data ingestion, transformation, and storage using Cloud Data Fusion, Dataflow (Apache Beam), or Composer (Airflow). Architect and implement data models on GCP to support efficient data storage and retrieval in BigQuery, Cloud Spanner, or Firestore. Collaborate with data architects to design and implement data la...

We are looking for a ML Ops Engineer to join our Technology team at Clarivate. You will get the opportunity to work in a cross-cultural work environment while working on the latest web technologies with an emphasis on user-centered design. About You (Skills & Experience Required) Bachelor’s or master’s degree in computer science, Engineering, or a related field. 3+ years of experience in machine learning, data engineering, or software development. Good experience in building data pipelines, data cleaning, and feature engineering is essential for preparing data for model training. Knowledge of programming languages (Python, R), and version control systems (Git) is necessary for building and m...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and d...

About the Project We are seeking a highly skilled and pragmatic Junior AI/ML Engineer to join the team building "a Stealth Prop-tech startup," a groundbreaking digital real estate platform in Dubai. This is a complex initiative to build a comprehensive ecosystem integrating long-term sales, short-term stays, and advanced technologies including AI/ML, data analytics, Web3/blockchain, and conversational AI. You will be responsible for operationalizing the machine learning models that power our most innovative features, ensuring they are scalable, reliable, and performant. This is a crucial engineering role in a high-impact project, offering the chance to build the production infrastructure for...