140 Cloud Composer Jobs - Page 2

Job Description We are looking for an experienced GCP Data Engineer with a minimum of 5+ years of professional experience in data engineering, cloud-based data solutions, and large-scale distributed systems. This role is fully remote and requires a hands-on professional who can design, build, and optimize data pipelines and solutions on Google Cloud Platform (GCP). Key Responsibilities Architect, design, and implement highly scalable data pipelines and ETL workflows leveraging GCP services. Develop and optimize data ingestion, transformation, and storage frameworks to support analytical and operational workloads. Work extensively with BigQuery, Dataflow, Pub/Sub, Dataproc, Data Fusion, Cloud...

As a Senior Engineer in the Data - IT squad at Deutsche Bank located in Pune, India, you will play a crucial role in designing solutions aligned with the bank's architecture principles and strategic goals. Your primary responsibility will involve collaborating with cloud engineers to develop cutting-edge data ingestion and processing solutions using Google Cloud Platform (GCP) capabilities. - Understand and serve as a Subject Matter Expert (SME) for the current systems landscape in Private Bank/Wealth Management, including end-to-end business process flows. - Document business and technology requirements for change projects, collaborating with technical resources to provide architectural and...

As a Senior Associate in data analysis at PwC, you will play a crucial role in leveraging data to drive insights and support clients in making informed business decisions. Your responsibilities will include utilizing advanced analytics techniques to extract insights from large datasets, manipulating data, creating visualizations, and employing statistical modeling to solve complex business problems. Key Responsibilities: - Proven expertise in supply chain analytics including demand forecasting, inventory optimization, logistics, segmentation, and network design - Hands-on experience with optimization methods like linear programming, mixed integer programming, scheduling optimization, and usi...

Cloud Data and AI Engineer, AVP Position Overview Job Title: Cloud Data and AI Engineer, AVP Location: Bangalore, India Role Description We are seeking an experienced Cloud (GCP) Data and AI engineer to play a key role in development and implementation of AI and Data engineering solutions. Candidate will work as an Engineering Team member in collaboration with business function and will be responsible forbuilding and deploying robust and scalable AI and data engineering solutions, in-line with bank's AI strategy, driven by business value to improve operational efficiency and enhance customer experience. Deutsche Bank's Corporate Bank division is a leading provider of cash management, trade f...

Project-Based Data Platform Engineer (AWS + GCP / S3 + BigQuery) About Kikeke Vortexium Technologies Kikeke Vortexium Technologies Private Limited is a technology company based in Indore, India , developing high-performance data and gaming platforms for the Casino Elite Group (Belgium) . We are currently expanding our data infrastructure to enable advanced analytics, business intelligence, and financial reporting across multiple business entities in Europe and Asia. Our next milestone is to build a hybrid data platform combining AWS and Google Cloud technologies keeping Amazon S3 as our data lake and BigQuery as our analytics warehouse. Project Overview We are seeking an experienced Data Pla...

As a highly experienced GCP Data Engineer (AdTech), your role will involve leading the analytics team, building scalable data pipelines, and mentoring analysts. Your responsibilities will include: - Leading and mentoring a team of data analysts to ensure quality delivery and technical upskilling. - Designing, developing, and maintaining scalable ETL/ELT pipelines using GCP tools such as BigQuery, Dataflow, Cloud Composer, Cloud Functions, and Pub/Sub. - Ingesting and processing log-level data from platforms like Google Ad Manager, Google Analytics, DV360, and other advertising and marketing tech sources. - Building and optimizing data pipelines from diverse sources via APIs, cloud connectors...

As an experienced and highly skilled GCP Data Engineer, your role will involve designing, developing, and maintaining robust data pipelines and cloud-based solutions on Google Cloud Platform. You will collaborate closely with data analysts, architects, and stakeholders to build scalable and efficient data systems. Key Responsibilities: - Design, build, and maintain scalable ETL/ELT pipelines using GCP tools such as Cloud Dataflow, BigQuery, Cloud Composer, and Cloud Storage. - Develop and optimize data models for analytics and reporting using BigQuery. - Implement data quality, data governance, and metadata management best practices. - Collaborate with data scientists, analysts, and other en...

As a Data Engineer at our company, you will be responsible for designing, developing, and maintaining scalable and efficient data pipelines using GCP services such as Dataflow, Cloud Composer (Airflow), and Pub/Sub. Your role will involve designing and implementing robust data models optimized for analytical and operational workloads within GCP data warehousing solutions like BigQuery. Additionally, you will develop and implement ETL processes to ingest, cleanse, transform, and load data from various sources into the data warehouse and other data stores on GCP. Key Responsibilities: - Build and manage data warehousing solutions on GCP, ensuring data integrity, performance, and scalability. -...

Job Title: Senior Data Analyst AdTech (Team Lead) Location: Hyderabad Experience Level: 46 Years Employment Type: Full-time Shift Timings: 5PM - 2AM IST About The Role We are looking for a highly experienced and hands-on Senior Data Analyst (AdTech) to lead our analytics team. This role is ideal for someone with a strong background in log-level data handling , cross-platform data engineering , and a solid command of modern BI tools . You'll play a key role in building scalable data pipelines, leading analytics strategy, and mentoring a team of analysts. Key Responsibilities Lead and mentor a team of data analysts, ensuring quality delivery and technical upskilling. Design, develop, and maint...

As a Data Engineer at UST, your role involves designing, developing, and optimizing ETL pipelines using PySpark on Google Cloud Platform (GCP). You will work with various GCP services such as BigQuery, Cloud Dataflow, Cloud Composer (Apache Airflow), and Cloud Storage for data transformation and orchestration. Your responsibilities will include: - Developing and optimizing Spark-based ETL processes for large-scale data processing. - Implementing best practices for data governance, security, and monitoring in a cloud environment. - Collaborating with data engineers, analysts, and business stakeholders to understand data requirements. - Troubleshooting performance bottlenecks and optimizing Sp...

Position Overview Job Title: Data Engineer (ETL, Big Data, Hadoop, Spark, GCP) , Assistant Vice President Location: Pune, India Role Description Senior engineer is responsible for developing and delivering elements of engineering solutions to accomplish business goals. Awareness is expected of the important engineering principles of the bank. Root cause analysis skills develop through addressing enhancements and fixes 2 products build reliability and resiliency into solutions through early testing peer reviews and automating the delivery life cycle. Successful candidate should be able to work independently on medium to large sized projects with strict deadlines. Successful candidates should ...

As an experienced GCP Administrator, your role will involve managing and configuring roles/permissions in GCP IAM, optimizing Big Query service, collaborating with various teams for efficient data management in GCP, creating automations and monitoring mechanisms, designing GCP-specific cloud architecture, provisioning and de-provisioning GCP accounts, and keeping technical documentation up to date. You will also be required to stay up to date on GCP announcements and services. Key Responsibilities: - Manage and configure roles/permissions in GCP IAM following the principle of least privileged access - Optimize Big Query service by managing slot assignments and SQL Queries, adopting FinOps pr...

Who We Are VOIS (Vodafone Intelligent Solutions) is a strategic arm of Vodafone Group Plc, creating value for customers by delivering intelligent solutions through Talent, Technology & Transformation. As the largest shared services organisation in the global telco industry with 30,000 FTE, our portfolio of next-generation solutions and services are designed in partnership with customers across Vodafone Group, local markets, and partner markets to simplify and drive growth. With our strategic partner Accenture, we work alongside our Vodafone customers, other Telco and tech companies to drive transformation, meet the challenges of our industry and ensure we stay relevant and resilient. This pa...

Job description Some careers shine brighter than others. If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions. We are currently seeking an experienced professional to...

Dear Candidate, We have opening for Google Cloud Platform (GCP) Lead, please find the detailed description below Company Details : Royal Cyber is a trusted global IT consulting & digital transformation partner, empowering enterprises for over two decades to evolve with agility, security, and innovation. Founded in 2002, Royal Cyber has built a strong legacy of helping organizations modernize legacy systems, embrace cloud-native technologies, and adopt AI-driven solutions. With 20+ years of delivering business-critical digital projects, we serve clients across USA, Canada, UK, UAE, KSA, India, Australia, and more with innovation hubs and delivery centers strategically located to support 24/7 ...

Atos is a global leader in digital transformation,European number one in Cloud, Cybersecurity and High-Performance Computing, the Group provides end-to-end Orchestrated Hybrid Cloud, Big Data, Business Applications and Digital Workplace solutions. The Group is the Worldwide Information Technology Partner for the Olympic & Paralympic Games and operates under the brands Atos, Atos Syntel, and Unify. Atos is a SE (Societas Europaea), listed on the CAC40 Paris stock index. The purpose of Atos is to help design the future of the information space. Its expertise and services support the development of knowledge, education and research in a multicultural approach and contribute to the development o...

Role Overview We are seeking a proficient ETL Developer with a strong emphasis on Software Development Engineer in Test (SDET) responsibilities. The ideal candidate will possess hands-on experience in developing, testing, and maintaining ETL pipelines, with a deep understanding of data integration, transformation, and validation processes. This role requires expertise in Google Cloud Platform (GCP) services, advanced SQL, and robust testing methodologies. #Mandatory skills - ETL Pipeline Big query , Strong SQL , Airflow and Dag #Details Experience in Data Engineering - Development and Testing Strong knowledge in Database Concepts, ETL/ELT, star schema, data modelling Strong experience in dat...

Job Description: We are looking for an experienced GCP Administrator to join our team. The ideal candidate will have strong hands-on experience with IAM Administration, multi-account management, Big Query administration, performance optimization, monitoring and cost management within Google Cloud Platform (GCP). Responsibilities: ? Manages and configures roles/permissions in GCP IAM by following the principle of least privileged access ? Manages Big Query service by way of optimizing slot assignments and SQL Queries, adopting FinOps practices for cost control, troubleshooting and resolution of critical data queries, etc ? Collaborate with teams like Data Engineering, Data Warehousing, Cloud ...

Job description Key Responsibilities: Design, build, and optimize scalable ETL/ELT pipelines using PySpark on both Hadoop and GCP environments. Utilize Hadoop ecosystem components including Hive , HDFS , YARN , and Oozie for data storage, processing, and workflow orchestration. Implement and manage GCP data services such as BigQuery , Cloud Storage , Dataflow , and Cloud Composer to support data ingestion, transformation, and analytics workloads. Ensure the performance, scalability, and reliability of data pipelines to meet business and operational requirements. Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to understand data needs and...

Position Overview: We are seeking a skilled and passionate Data Engineer with deep expertise in Google Cloud Platform (GCP) and Google BigQuery. In this role, you will architect, build, and maintain the scalable data pipelines that are the foundation of our analytics and data science initiatives. You will be responsible for the entire data lifecycle, from ingestion and processing to warehousing and serving. You will work on creating a reliable, efficient, and high-quality data ecosystem that empowers our data analysts, data scientists, and business leaders to make critical data-informed decisions. ShyftLabs is a growing data product company that was founded in early 2020 and works primarily ...

Position Overview: We are seeking a skilled and passionate Data Engineer with deep expertise in Google Cloud Platform (GCP) and Google BigQuery. In this role, you will architect, build, and maintain the scalable data pipelines that are the foundation of our analytics and data science initiatives. You will be responsible for the entire data lifecycle, from ingestion and processing to warehousing and serving. You will work on creating a reliable, efficient, and high-quality data ecosystem that empowers our data analysts, data scientists, and business leaders to make critical data-informed decisions. ShyftLabs is a growing data product company that was founded in early 2020 and works primarily ...

Role Overview: You will be responsible for designing, developing, and maintaining scalable and efficient data pipelines using GCP services such as Dataflow, Cloud Composer (Airflow), and Pub/Sub. Additionally, you will design and implement robust data models optimized for analytical and operational workloads within GCP data warehousing solutions like BigQuery. Your role will involve developing and implementing ETL processes to ingest, cleanse, transform, and load data from various sources into our data warehouse and other data stores on GCP. Furthermore, you will build and manage data warehousing solutions on GCP, ensuring data integrity, performance, and scalability. Collaborating with data...

Work Location: ~CHENNAI, TN. Skill Required: Digital : Google Data Engineering Experience Range in Required Skills: 4-6 years Job Description: Develops and maintain scalable data pipelines using GCP cloud Infrastructure. Work closely with Business teams to help build complex Data migration pipelines to seamlessly onboard Data products. Help, streamline Data migration workflows, adding value to Client Data Hubs. Work on agile software development processes to onboard various data products of Client to GCP Cloud. Build and document scalable data pipelines that cleanse, transform and curate the data to insights. Build reusable frameworks to ingest different data patterns. Primary Skills: Python...

As an Engineer with 5-8 years of experience, your role will involve working with competencies like Apache Beam, GCP Cloud, and Open Shift. You should have hands-on experience in Java and Kafka Streaming, with knowledge in GCP and Kubernetes being a plus. Your responsibilities will include developing and deploying data and analytics-led solutions on GCP, as well as designing highly available and scalable systems. You will be working on Data Engineering solutions using Cloud BigQuery, Cloud DataFlow, Cloud BigTable, Storage, Cloud Spanner, and Cloud IAM. It's essential to have a good understanding of Apache Kafka and proficiency in cloud-based ETL/Data Orchestration tools like Apache Beam and ...

Experience : 8.00 + years Salary : Confidential (based on experience) Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full time Permanent Position (*Note: This is a requirement for one of Uplers client - Forbes Advisor) What do you need for this opportunity Must have skills required: Google Cloud, Dataflow, GCP, BigQuery, GCP certification, GCP Certificate Forbes Advisor is Looking for: Senior GCP Cloud Administrator Forbes Advisor is a new initiative for consumers under the Forbes Marketplace umbrella that provides journalist- and expert-written insights, news and reviews on all things personal finance, health, business, and everyday life decisions. We do t...