224 Cloud Composer Jobs

As a Data Engineer at our company, your primary responsibilities will include: - Designing, developing, and maintaining scalable and efficient data pipelines using GCP services such as Dataflow, Cloud Composer (Airflow), and Pub/Sub. - Designing and implementing robust data models optimized for analytical and operational workloads within GCP data warehousing solutions like BigQuery. - Developing and implementing ETL (Extract, Transform, Load) processes to ingest, cleanse, transform, and load data from various sources into our data warehouse and other data stores on GCP. - Building and managing data warehousing solutions on GCP, ensuring data integrity, performance, and scalability. - Collabo...

About Cittabase Company overview Our Approach Our Values and Core Principles Careers Events Department: Data Analytics Project Location(s): Chennai, TN, India Education: Professional Degree Job Description We are looking for a Sr. Data Engineer with strong hands-on Data Vault 2.0 modelling and design experience, advanced SQL skills, and solid data warehousing fundamentals. The role requires practical experience with the GCP stack (BigQuery, Dataflow, Cloud Composer) and strong exposure to Dataplex . Candidates should be proficient in taxonomy, ontology, and designing agile data models that separate and organize data domains effectively. Responsibilities Design and implement Data Vault 2.0 mo...

As a GCP Data Engineer specializing in Data Migration & Transformation, your role will involve designing and building robust, scalable data pipelines and architectures on GCP, with a focus on BigQuery. Your responsibilities will include migrating and transforming large-scale data systems to GCP while ensuring performance, scalability, and reliability. You will automate data lineage extraction, maintain data integrity across platforms, and collaborate with stakeholders to implement GCP-native and 3rd-party tools for data ingestion and integration. Additionally, you will optimize complex SQL queries in BigQuery for data analysis, operationalize data pipelines using tools like Apache Airflow, D...

As an Engineer with 5-8 years of experience, you will be responsible for the following: - Engineer having competencies in Apache Beam, GCP Cloud, and Open Shift - Experience in Java and Kafka Streaming; knowledge of GCP and Kubernetes is a plus - Developing and deploying data and analytics-led solutions on GCP - Designing highly available and scalable systems - Hands-on experience with Data Engineering solutions using Cloud BigQuery, Cloud DataFlow, Cloud BigTable, Storage, Cloud Spanner, Cloud IAM - Understanding of Apache Kafka - Proficiency in cloud-based ETL/Data Orchestration tools like Apache Beam and Cloud Composer - Experience with Stack driver logging/monitoring - Proficient in Pyth...

As a highly experienced GCP Data Engineer (AdTech), you will play a crucial role in leading the analytics team by utilizing your expertise in log-level data handling and modern BI tools. Your responsibilities will include designing scalable ETL/ELT pipelines, ingesting and processing log-level data from various platforms, building data models, and maintaining intuitive dashboards. Additionally, you will mentor a team of data analysts, ensure data governance standards, and collaborate with cross-functional teams to derive strategic insights from data. **Key Responsibilities:** - Lead and mentor a team of data analysts, ensuring quality delivery and technical upskilling. - Design, develop, and...

Job Description Senior Consultant Delivery ( Data Engineer) About Worldline At Worldline, we are pioneers in payments technology, committed to creating innovative solutions that make financial transactions secure, accessible, and seamless worldwide. Our diverse team of professionals collaborates across cultures and disciplines, driving progress that benefits society and businesses of all sizes. We believe that diverse perspectives fuel innovation and are dedicated to fostering an inclusive environment where all individuals can thrive. The Opportunity We are seeking a highly skilled and knowledgeable Data Engineer to join our Data Management team on a transformative Move to Cloud (M2C) projec...

Greetings from Tata Consultancy Services!! We are hiring GCP Data Engineer ! Position: GCP Data Engineer Job Location: Chennai/Bangalore/Hyderabad/Gurugram/Pune Experience : 10-12 years Interested professionals kindly apply through the link. Must Have: Proficiency in programming languages: Python, Java - Expertise in data processing frameworks: Apache Beam (Data Flow) - Active experience on GCP tools and technologies like Big Query, Dataflow, Cloud Composer, Cloud Spanner, GCS, DBT etc., - Data Engineering skillset using Python, SQL - Experience in ETL (Extract, Transform, Load) processes - Knowledge of DevOps tools like Jenkins, GitHub, Terraform is desirable. Should have good knowledge on ...

Some careers shine brighter than others. If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions. We are currently seeking an experienced professional to join our team i...

At American Express, our culture is built on a 175-year history of innovation, shared values and Leadership Behaviors, and an unwavering commitment to back our customers, communities, and colleagues. As part of Team Amex, you'll experience this powerful backing with comprehensive support for your holistic well-being and many opportunities to learn new skills, develop as a leader, and grow your career. Here, your voice and ideas matter, your work makes an impact, and together, you will help us define the future of American Express. How will you make an impact in this role You'll play a key role in driving automation, building robust data integration services, and enabling seamless connectivit...

Greetings from Tata Consultancy Services!! We are hiring Data Engineers ! Experience : 10 - 12 years Location : PAN India Interested professionals kindly apply through the link. Must Have Skills: Google Cloud Data Engineering BigQuery, Dataflow, Cloud composer, Cloud Pub/Sub, Designing, building, and maintaining scalable data pipelines and architectures on Google Cloud Platform SQL, Database/schema design, ETL, write queries to extract, transform data from multiple Data sources. Write complex SQL/Bigquery/DBT Queries for analysis and reporting ETL : Develop ETL solutions on Google cloud platform, Develop Data model, move data from various sources into Data warehouse BigQuery Data Analytics P...

You are a certified and proactive Scrum Master responsible for leading Agile execution across the MarTech Data & Analytics team. Your role involves driving the delivery of consumer data products, segmentation workflows, analytics dashboards, and integrations crucial for powering high-impact digital campaigns and business insights. **Key Responsibilities:** - Facilitate Agile ceremonies such as sprint planning, daily stand-ups, retrospectives, and PI planning events according to the SAFe framework. - Guide multiple squads across platforms like BlueConic, Salesforce, ThoughtSpot, Klaviyo, GBQ, and Shopify. - Partner with Product Owners to maintain prioritized backlogs and ensure high team velo...

GCP Infrastructure Lead Location: Bangalore, Pune Exp: 3+ Years Responsibilities: 3+ years of demonstrated relevant experience deploying and supporting public cloud Infrastructure (GCP as primary) IaaS and PaaS. Experience in configuring and managing the GCP infrastructure environment components Foundation components Networking (VPC, VPN, Interconnect, Firewall and Routes), IAM, Folder Structure, Organization Policy, VPC Service Control, Security Command Center etc. Application Components - BigQuery, Cloud Composer, Cloud Storage, Google Kubernetes Engine (GKE), Compute Engine, Cloud SQL, Cloud Monitoring, Dataproc, Data Fusion, Big Table, Dataflow etc. Design and implement Identity and Acce...

As a Senior Data Engineer at EY Advisory - Data and Analytics, you will have the opportunity to leverage your expertise in the Financial Services domain to design, build, and maintain scalable data pipelines and solutions. Your role will involve working with big data ecosystems and cloud technologies like GCP, Azure, or AWS to process large datasets efficiently. Here are the primary skills and key responsibilities for this role: - Strong knowledge in Spark and a good understanding of the Spark framework, including performance tuning. - Proficiency in Scala and SQL. - Hands-on experience in designing and building scalable data pipelines. - Experience with one of the Cloud technologies - GCP, ...

As a Backend Software Engineer at Wayfair, you will be joining the Fulfillment Optimization team responsible for enhancing and scaling customer-facing platforms to optimize Wayfair profitability and customer satisfaction. Your role will involve maintaining an accurate representation of the dynamic supply chain, predicting how products fit into boxes, and surfacing information for customers and suppliers in real-time. Your responsibilities will include: - Building and launching data pipelines and products focused on SMART Org. - Collaborating with teams to create new product features and machine learning models using data insights. - Establishing cross-functional relationships to understand d...

As a Senior Cloud Data Engineer at CloudWerx, you will be at the forefront of cloud technology, architecting and implementing cutting-edge data solutions that drive business transformation. You'll work with a diverse portfolio of clients, from startups to industry leaders, using the latest GCP technologies. This role offers a unique blend of technical expertise and client interaction, allowing you to build sophisticated data systems and consult directly with clients to shape their data strategies. Your work will have a real-world impact on shaping the future of data-driven decision making. **Key Responsibilities:** - Lead technical discussions with clients, translating complex technical conc...

Junior Dev Cloud Engineer 886 Location: Chennai, Kochi, Pune, Thiruvananthapuram Experience: 03 Years Notice Period: 015 Days (Mandatory) Education: Bachelor's degree in Computer Science, Engineering, or related field Job Stability: Required Job Overview We are seeking a highly motivated Junior Dev Cloud Engineer to develop, deploy, and optimize scalable data processing and orchestration solutions on Google Cloud Platform (GCP) . The ideal candidate should have hands-on experience in Java 17+ , Apache Beam , and Airflow/Cloud Composer , along with a solid understanding of GCP Big Data services. Key Responsibilities Design, develop, test, and deploy scalable data processing pipelines using Ja...

AuxoAI is seeking aSenior Data Engineerto lead the design, development, and optimization of modern data pipelines and cloud-native platforms usingGoogle Cloud Platform (GCP). This role is ideal for someone with deep experience building scalable batch and streaming data workflows, strong hands-on engineering skills, and a drive to mentor junior engineers. You'll work closely with cross-functional teams to build production-grade pipelines using tools likeBigQuery, Dataflow, Pub/Sub, Cloud Composer, andDataform, enabling high-quality data delivery and analytics at scale. Responsibilities: Build and optimizebatch and streaming data pipelinesusingApache Beam (Dataflow) Design and maintainBigQuery...

At EY, you'll have the chance to build a career as unique as you are, with the global scale, support, inclusive culture and technology to become the best version of you. And we're counting on your unique voice and perspective to help EY become even better, too. Join us and build an exceptional experience for yourself, and a better working world for all. EY GDS Data and Analytics - D and A GCP Data Engineer - Senior As part of our EY-GDS D&A (Data and Analytics) team, we help our clients solve complex business challenges with the help of data and technology. We dive deep into data to extract the greatest value and discover opportunities in key business and functions like Banking, Insurance, M...

JOB DESCRIPTION Pro 360 Data Platforms & Engineering Product Line: Leads design and product teams wi create the operational core data capability for Ford Pro Tech. Includes ETL processes, multi-tier data model designs and implementations, data quality strategy & monitoring, plus domain expertise of data sets in the environment, third-party data evaluations, data quality, creating intelligence layers for ease of use. RESPONSIBILITIES Develop EL/ELT/ETL pipelines to make data available in BigQuery analytical data store from disparate batch, streaming data sources for the Business Intelligence and Analytics teams. Work with on-prem data sources (Hadoop, SQL Server), understand the data model, b...

GCP Data Engineer | Gurugram/ Bengaluru | 6 - 10 years Job Description: We are seeking experienced GCP Data Engineers to design, build, and optimize scalable data pipelines and analytics solutions on Google Cloud Platform (GCP). The ideal candidate will have strong expertise in Python, PySpark, SQL, and ETL concepts, with hands-on experience across GCP's data engineering services such as BigQuery, Dataflow, and Dataproc . Key Responsibilities: Design, build, and maintain scalable data pipelines for processing high-volume datasets. Develop, optimize, and manage ETL workflows using Python, PySpark, and SQL . Implement solutions on BigQuery, Dataflow, Dataproc, and Cloud Storage to enable analy...

About Us: Successive Digital, a digital transformation company, offers a comprehensive suite of solutions, including digital strategy, product engineering, CX, Cloud, Data & AI, and Generative AI services. We help companies continuously optimize business and technology that transform how they connect with customers and grow their business. Our team of technology specialists ensures that each solution is customized to the business's specific needs, driving efficiency and performance. With the implementation of the latest technological advancements, we deliver business operations that ensure business continuity and make you stay ahead in a rapidly evolving digital landscape. Our Technical Expe...

As a Data Architect GCP at AuxoAI, you will play a crucial role in leading enterprise data platform design and architecture modernization for global client engagements. Your responsibilities will include designing scalable data architectures using GCP-native services, guiding data engineering teams, and defining best practices for ingestion, transformation, governance, and consumption layers. Key Responsibilities: - Design and implement enterprise-scale data architectures using GCP services, with a focus on BigQuery as the central analytics platform. - Lead the end-to-end implementation of medallion architecture (Raw Processed Curated) patterns. - Oversee data ingestion pipelines utilizing C...

We are looking for an experienced GCP Data Engineer with strong hands-on expertise in Python, BigQuery, Dataflow, and Cloud Composer . In this role, you will design, build, and maintain scalable data pipelines on Google Cloud Platform (GCP) , working closely with business and technology teams to enable reliable data migration, transformation, and analytics use cases. Roles & Responsibilities Design & Develop Data Pipelines Design, develop, and maintain scalable, secure, and reliable data pipelines using GCP services (BigQuery, Dataflow, Cloud Composer, GCS, etc.). Build end-to-end data ingestion and transformation workflows from various source systems (databases, APIs, flat files, etc.). Dat...

Skills : GCP Cloud Data Engineer Related . Position : Developer / Senior Developer, Senior Consultant / Lead Consultant / Technical Specialist / Senior Technical Specialist / Team Leader / Architect / Product Manager. Work Experience : 5.00Years to 10.00 Years Work Location : Only Bangalore & Hyderabad Location Job Type : Permanent Employee (Direct Payroll) This is for CMM Level 5 Indian MNC Opening in Bangalore & Hyderabad Location - Have you applied before = Yes/No = Below Mentioned All the Details are Mandatory - Please Send : Please confirm your availability for the F2F Hackathon Interview scheduled for December 6th, 2025. The interview will take place between 9:30 AM and 5:00 PM IST at ...

As a Data Engineer at DataNimbus, you will play a crucial role in designing, developing, and maintaining a highly scalable data warehouse solution in BigQuery. Your responsibilities will include: - Designing data models, schemas, and partitioning strategies to ensure efficient query performance. - Building and maintaining ETL/ELT pipelines using tools like Dataflow, Dataproc, Cloud Composer (Airflow), or dbt. - Optimizing query performance and managing cost-efficient BigQuery usage. - Implementing data governance, security, and compliance best practices such as IAM, data masking, and audit logging. - Collaborating with data analysts, data scientists, and business stakeholders to deliver reli...