15348 Airflow Jobs - Page 33

Team :- Strategy & Consulting Global Network Practice :- Marketing Analytics Title :- Consultant/ Manager/Analyst Marketing & Customer Data Platforms (GCP, CDP, Agentic AI) Job location :- Any out of 6 AI locations WHAT'S IN IT FOR YOU? As part of our Analytics practice, you will join a worldwide network of over 20k+ smart and driven colleagues experienced in leading AI/ML/Statistical tools/Agentic AI systems, methods and applications. From data to analytics and insights to actions, our forward-thinking consultants provide analytically-informed, issue-based insights at scale to help our clients improve outcomes and achieve high performance. What you would do in this role A Consultant/Manager...

Role: Data Engineering Remote Looking for 5-10 years of Exp • Design, develop & maintain ETL/ELT pipelines • Ingest & transform data from APIs, DBs, files, streams • Build real-time & batch processing solutions • Data validation, quality & cleansing • Translate business needs into data models • Ensure data security, access control & compliance • Maintain documentation & best practices Snowflake, AWS/GCP/Azure, Databricks (Lakehouse + Spark), BigQuery (Google Cloud), Azure Synapse / AWS Redshift, Kafka, Azure Data Factory, AWS Glue, Apache Spark, Apache Hadoop, Airflow, dbt, PySpark, SQL, Real-time & Batch Pipelines, Data Quality & Governance, Informatica, Talend, Collibra.

Role: Azure Data Engineer Experience: 6–8 Years Mandatory Skills: Python: 6–8 years Databricks: 6–8 years Apache PySpark: 6–8 years Azure Cloud: 6–8 years Apache Airflow: 6–8 years SQL & Data Warehousing Concepts: 6–8 years

OUR STORY Let’s be honest: there are lots of people out there doing what we do. We’re just not convinced they’re doing it right. Businesses are hungry for innovation and opportunity, but not at the cost of their independence. At Ollion, we’ve connected companies and capabilities around the world to help ambitious organizations make the most of their transformation and leave the status quo in the dust. WORKING AT OLLION Innovation is risky. It demands bold steps and big questions, but that’s the price of making change. We’ve got our head in the cloud and two feet on the ground, channeling tech’s endless potential towards a single goal: making a world of difference. And we’re building a global...

If you are a passionate Data Engineer with strong hands-on experience Flink, Kafka, Airflow, we would love to hear from you. Please submit your resume and cover letter detailing your relevant experience and qualifications to mamatha.n@skill-mine.com

Key Responsibilities Design, develop, and maintain scalable data pipelines and ETL/ELT workflows. Lead the migration of existing workflows to GCP’s Dataform and establish a robust data pipeline framework. Build efficient systems for data ingestion, transformation, and delivery across platforms. Collaborate with engineering, product, and analytics teams to ensure data accessibility and integrity. Implement and monitor data governance, quality, and performance standards. Optimize GCP resources for performance and cost efficiency. Continuously evaluate and integrate new tools and technologies to enhance pipeline performance. Required Skills & Experience 6+ years of hands-on experience as a Data...

We are seeking an experienced GCP Data Engineer with 5+ years of hands-on experience in designing, developing, and optimizing large-scale data pipelines using Google Cloud Platform (GCP) services The ideal candidate should be proficient in BigQuery and DataProc (PySpark), with a strong understanding of data modeling, query performance optimization, and cloud-based ETL architectures The role involves collaborating with cross-functional teams to translate business requirements into efficient data workflows, ensuring data quality, consistency, and scalability Proficiency in Python and SQL is essential, along with the ability to troubleshoot, debug, and optimize existing pipelines Experience wit...

Required Skills 5- years of IT experience Advanced skill in configuring and supporting software applications Good knowledge in writing complex SQL queries Experience with object-oriented language (python is a Plus) Strong understanding of job orchestration tools like Jenkins and/or Airflow, code repository tools like Git and/or Bitbucket Strong software development and debug/troubleshooting skills Advanced ability to research, analyze and recommend improvements to the organizations use of the software applications Advanced skill in creating and maintaining technical documentation Nice to Have Skills: Prior Production Support experience Working knowledge of Spark and AWS technologies like S3,...

Key Responsibilities Design and implement data pipelines using GCP services such as BigQuery , Dataflow , Pub/Sub , Cloud Functions , and Cloud Storage . Develop and maintain ETL workflows leveraging Cloud Composer (Airflow) for orchestration. Migrate on-premise data systems to Google Cloud Platform , ensuring scalability and reliability. Optimize data warehouse solutions in BigQuery for performance and cost efficiency. Implement data quality checks , monitoring, and alerting using GCP tools. Collaborate with cross-functional teams to gather requirements and deliver actionable insights. Ensure compliance with data governance , security, and best practices. Work in Agile environments , managi...

Key responsibilities : Very good proficiency in Python and Spark programming. • Pandas: Experience with data manipulation and analysis using Pandas. • Implementation experience of Spark Core, Spark SQL and Spark Streaming • Working with Spark in combination Hadoop Ecosystem • Design and implementation of low-latency, high-availability, and performance applications. • Should lead and guide a team of junior Python developers. • As Sr Python Developer responsibilities include coding, testing, debugging, and troubleshooting throughout the application development process. • Performance tuning, improvement, balancing, usability, and automation. • Collaborate with other team members and stakeholder...

Job Description Job Description: Python Developer Location: Pune Experience: 6+ years Responsibilities Develop scalable applications using Python and frameworks like Django, Flask, or Pyramid. Work with libraries such as NumPy, Pandas, SciPy, Dask, spaCy, NLTK, scikit-learn, Airflow, and PyTorch. Build and maintain data pipelines and automation scripts. Integrate front-end components using HTML, CSS Manage databases (SQL and NoSQL) for application data storage. Required Skills Strong Python development experience with a proven portfolio. Excellent problem-solving, analytical and communication skills. Preferred Skills Experience in cloud platforms and containerization tools. Familiarity with ...

Entity :- Accenture Strategy & Consulting Team :- Strategy & Consulting Global Network Practice :- Marketing Analytics About S&C - Global Network (GN) :- Accenture GN's Data & AI (AI Hub India) practice help our clients grow their business in entirely new ways. Analytics enables our clients to achieve high performance through insights from data - insights that inform better decisions and strengthen customer relationships. From strategy to execution, Accenture works with organizations to develop analytic capabilities - from accessing and reporting on data to predictive modelling to outperform the competition. WHAT'S IN IT FOR YOU? As part of our Analytics practice, you will join a worldwide n...

Entity :- Accenture Strategy & Consulting Team :- Strategy & Consulting Global Network Practice :- Marketing Analytics About S&C - Global Network (GN) :- Accenture GN's Data & AI (AI Hub India) practice help our clients grow their business in entirely new ways. Analytics enables our clients to achieve high performance through insights from data - insights that inform better decisions and strengthen customer relationships. From strategy to execution, Accenture works with organizations to develop analytic capabilities - from accessing and reporting on data to predictive modelling to outperform the competition. WHAT'S IN IT FOR YOU? As part of our Analytics practice, you will join a worldwide n...

Join us as a Software Engineer, PySpark This is an opportunity for a technically minded individual to join us as a Software Engineer Youll be designing, producing, testing and implementing working software, working across the lifecycle of the system Hone your existing software engineering skills and advance your career in this critical role We're offering this role at vice president level What you'll do Working in a permanent feature team, youll be developing knowledge of aspects of the associated platform across the disciplines of business, applications, data and infrastructure. Youll also be liaising with principal engineers, architects in the domain and other key stakeholders to understan...

Job Description Entity :- Accenture Strategy & Consulting Team :- Strategy & Consulting Global Network Practice :- Marketing Analytics Title :- Consultant/ Manager/Analyst Marketing & Customer Data Platforms (GCP, CDP, Agentic AI) Job location :- Any out of 6 AI locations What you would do in this role A Consultant/Manager/Analyst for Customer Data Platforms serves as the day-to-day marketing technology point of contact and helps our clients get value out of their investment into a Customer Data Platform (CDP) by developing a strategic roadmap focused on personalized activation. You will be working with a multidisciplinary team of Solution Architects, Data Engineers, Data Scientists, and Dig...

ABOUT THE ROLE We are seeking a seasoned Senior Data Engineer to drive the development and implementation of our data strategy. The ideal candidate possesses a strong blend of technical expertise and data-driven problem-solving skills. As a Senior Data Engineer, you will play a crucial role in designing, building, and optimizing our data pipelines and platforms while mentoring junior engineers. Roles & Responsibilities: Contribute to the design, development, and implementation of automations to monitor our data and cloud platforms for reliability, cost, and maintenance. Take ownership of platform management, managing scope, timelines, and risks. Ensure data quality and integrity through rigo...

Data Engineering Manager What you will do In this vital role you will lead a team of data engineers to build, optimize, and maintain scalable data architectures, data pipelines, and operational frameworks that support real-time analytics, AI-driven insights, and enterprise-wide data solutions. As a strategic leader, the ideal candidate will drive best practices in data engineering, cloud technologies, and Agile development, ensuring robust governance, data quality, and efficiency. The role requires technical expertise, team leadership, and a deep understanding of cloud data solutions to optimize data-driven decision-making. Lead and mentor a team of data engineers, fostering a culture of inn...

Role Description: We are seeking an experienced Data Engineer for the development and implementation of our data strategy. The ideal candidate possesses a strong blend of technical expertise and data-driven problem-solving skills. As a Data Engineer, you will play a crucial role in building, and optimizing our data pipelines and platforms in a SAFE Agile product team. Roles & Responsibilities: Contribute to the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions. Deliver for data pipeline projects from development to deployment, managing, timelines, and risks. Ensure data quality and integrity through rigorous testing and monitoring. L...

Role Description: The Commercial Data Management Manager will be responsible for managing the execution of the Data Platforms Operations in partnership with the Technology team, driving continuous innovation, operational excellence, and cost efficiencies. The manager will oversee execution of features aligned with one or more of our Data Platform product teams and work with the global team and functional partners to implement additional capabilities to the platform aligned with business objectives. Also, the manager will partner with the Senior Manager, Data Platforms to initially focus on the transition efforts from the vendor teams, building a highly talented and data-focused team in our I...

ABOUT THE ROLE Amgen is seeking a Sr. Associate IS Business Systems Analyst with strong data science and analytics expertise to join the Digital Workplace Experience (DWX) Automation & Analytics product team. In this role, you will develop, maintain , and optimize machine learning models, forecasting tools, and operational dashboards that support strategic and day-to-day decisions for global digital workplace services. This role is ideal for candidates with hands-on experience building predictive models and working with large operational datasets to uncover insights and deliver automation solutions. You will work alongside product owners, engineers, and service leads to deliver measurable bu...

Job Description Summary: Data Scientist Manager, V&A Transformation Initiatives (L5) What You Will Do As Manager V&A Transformation Initiatives, you will be at the forefront of solving the US Value & Access teams biggest challenges using cutting edge technology. The AIN Transformation team will be viewed as an innovation engine, constantly testing and refining analytics solutions to address customer needs and opportunities alongside business partners. In your role as a manager, youll be expected to combine a deep understanding of access data and analytics with experience in developing and deploying advanced machine learning, operational research, semantic analysis, and statistical methods to...

Role Description: Amgen is seeking a Specialist Software Engineer to contribute to designing, building, maintaining , analyzing, and interpreting data to provide actionable insights that drive business decisions. This role involves working with large datasets, developing data pipelines, supporting and executing data governance initiatives and visualizing data to ensure data is accessible, reliable, and efficiently managed. The ideal candidate has strong technical skills and experience with MuleSoft, Databricks, Airflow and AWS. Roles & Responsibilities: Design, develop, and maintain data solutions for data generation, collection, and processing using Databricks and Airflow Design, build and ...

Role Name: Sr Associate Data Analytics Department: TBD Role GCF: 4 Hiring Manager: TBD Role Description This role will play a key part in supporting Amgens Tech & Workforce Strategy by designing and building robust, scalable data pipelines that enable advanced analytics and insights. We are seeking an expert-level data engineer who is eager to gain exposure to the business/FP&A side of Biotech. You bring the data engineering masterywell teach you the business context. This is a rare opportunity to grow your career at the intersection of cutting-edge engineering and strategic business decision-making. Please be aware that Amgens Tech & Workforce Strategy is a key strategic initiative to ensur...

Role: Associate Architect - Data Experience Level: 6 to 10 Years Work location: Mumbai, Bangalore or Trivandrum (Hybrid) Notice period: Preferred up to 45 days Role & Responsibilities: 5+ years of experience in building and managing Data Lakes, Data Warehouse, Data Integration, Data Migration and Business Intelligence/Artificial Intelligence solutions on GCP Cloud. Ability to understand business requirements, translate them into functional and non-functional areas, and define non-functional boundaries in terms of Availability, Scalability, Performance, Security, Resilience etc. Experience in architecting, designing, and implementing end-to-end data pipelines and data integration solutions fo...

ABOUT THE ROLE Role Description: We are seeking a highly skilled Machine Learning Engineer with a strong MLOps background to join our team. You will play a pivotal role in building and scaling our machine learning models from development to production. Your expertise in both machine learning and operations will be essential in creating efficient and reliable ML pipelines. Roles & Responsibilities: Collaborate with data scientists to develop, train, and evaluate machine learning models. Build and maintain MLOps pipelines, including data ingestion, feature engineering, model training, deployment, and monitoring. Leverage cloud platforms (AWS, GCP, Azure) for ML model development, training, and...