143 Cloud Composer Jobs - Page 3

Work Location: ~CHENNAI, TN. Skill Required: Digital : Google Data Engineering Experience Range in Required Skills: 4-6 years Job Description: Develops and maintain scalable data pipelines using GCP cloud Infrastructure. Work closely with Business teams to help build complex Data migration pipelines to seamlessly onboard Data products. Help, streamline Data migration workflows, adding value to Client Data Hubs. Work on agile software development processes to onboard various data products of Client to GCP Cloud. Build and document scalable data pipelines that cleanse, transform and curate the data to insights. Build reusable frameworks to ingest different data patterns. Primary Skills: Python...

As an Engineer with 5-8 years of experience, your role will involve working with competencies like Apache Beam, GCP Cloud, and Open Shift. You should have hands-on experience in Java and Kafka Streaming, with knowledge in GCP and Kubernetes being a plus. Your responsibilities will include developing and deploying data and analytics-led solutions on GCP, as well as designing highly available and scalable systems. You will be working on Data Engineering solutions using Cloud BigQuery, Cloud DataFlow, Cloud BigTable, Storage, Cloud Spanner, and Cloud IAM. It's essential to have a good understanding of Apache Kafka and proficiency in cloud-based ETL/Data Orchestration tools like Apache Beam and ...

Experience : 8.00 + years Salary : Confidential (based on experience) Shift : (GMT+05:30) Asia/Kolkata (IST) Opportunity Type : Remote Placement Type : Full time Permanent Position (*Note: This is a requirement for one of Uplers client - Forbes Advisor) What do you need for this opportunity Must have skills required: Google Cloud, Dataflow, GCP, BigQuery, GCP certification, GCP Certificate Forbes Advisor is Looking for: Senior GCP Cloud Administrator Forbes Advisor is a new initiative for consumers under the Forbes Marketplace umbrella that provides journalist- and expert-written insights, news and reviews on all things personal finance, health, business, and everyday life decisions. We do t...

As a Backend Software Engineer at Wayfair, you will be joining the Fulfillment Optimization team, responsible for building platforms that optimize customer order fulfillment for Wayfair profitability and customer satisfaction. Your role will involve enhancing and scaling customer-facing platforms that provide fulfillment information on the website, from search pages to order delivery. You will play a crucial role in maintaining an accurate representation of the dynamic supply chain, predicting product packaging, warehouse flow, and surfacing necessary information for customers, suppliers, and carriers in milliseconds. **Key Responsibilities:** - Build and launch data pipelines and products f...

**Job Description:** As a Senior Cloud Data Engineer at CloudWerx, you will play a vital role in architecting and implementing cutting-edge data solutions that drive business transformation using the latest Google Cloud Platform (GCP) technologies. Your work will involve collaborating with a diverse portfolio of clients, from startups to industry leaders, to solve complex data challenges and shape their data strategies for real-world impact. **Key Responsibilities:** - Lead technical discussions with clients to align complex technical concepts with their business goals. - Architect and implement innovative data solutions to enable clients to leverage their data assets effectively. - Collabor...

You will be responsible for the following tasks: - Experience in GCP. - Data migration experience from legacy systems including SQL, Oracle. - Experience with Data lake, data warehouse ETL pipelines build and design on GCP. - GCP data and analytics services like Cloud Dataflow, Cloud Dataprep, Apache Beam/Cloud composer, Cloud BigQuery, Cloud Fusion, Cloud PubSub, Cloud storage & Cloud Functions. - Using Cloud Native GCP CLI/gsutil along with scripting using Python & SQL. - Experience with Data Governance, Metadata Management, Data Masking & Encryption using GCP tools like Cloud Data Catalog, GCP KMS tools. No additional details about the company are mentioned in the job description.,

Job description Some careers shine brighter than others. If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions. We are currently seeking an experienced professional to...

As a Senior Data Engineer (Scala) at EY in the Advisory - Data and Analytics team, you will play a crucial role in leveraging your expertise in the Financial Services domain to solve complex issues and capitalize on opportunities that deliver better outcomes for businesses. Your primary responsibilities will include: - Demonstrating strong knowledge in Spark, with a good understanding of the Spark framework and performance tuning. - Proficiency in Scala & SQL to effectively work with data. - Exposure to at least one of the Cloud technologies - GCP/ Azure/ AWS. - Designing, building, and maintaining scalable data pipelines and solutions to efficiently manage and process large datasets. - Taki...

Job Description: The Google Cloud DevOps Engineer will be responsible for automating infrastructure provisioning and configuration management using Terraform and Ansible. The role involves designing, implementing, and maintaining CI/CD pipelines on GCP using Azure DevOps. The ideal candidate will have extensive experience with GCP resources, particularly in data engineering, and possess strong scripting skills in Python and Bash. Responsibilities: Automate infrastructure provisioning and configuration management using Terraform and Ansible. Design, implement, and maintain CI/CD pipelines on GCP using Azure DevOps. Manage and optimize GCP resources, including Compute Engine, Data Fusion, Data...

Job Description: The Google Cloud DevOps Engineer will be responsible for automating infrastructure provisioning and configuration management using Terraform and Ansible. The role involves designing, implementing, and maintaining CI/CD pipelines on GCP using Azure DevOps. The ideal candidate will have extensive experience with GCP resources, particularly in data engineering, and possess strong scripting skills in Python and Bash. Responsibilities: Automate infrastructure provisioning and configuration management using Terraform and Ansible. Design, implement, and maintain CI/CD pipelines on GCP using Azure DevOps. Manage and optimize GCP resources, including Compute Engine, Data Fusion, Data...

As a Scrum Master at our company, you will play a vital role in leading Agile execution across the MarTech Data & Analytics team. Your responsibilities will include coaching cross-functional teams, facilitating Agile ceremonies, and ensuring the delivery of high-impact digital campaigns and business insights. You will work closely with product owners, analysts, data engineers, QA, and marketing operations to ensure on-time delivery of work that drives executive decision-making and consumer engagement. Key Responsibilities: - Facilitate Agile ceremonies such as sprint planning, daily stand-ups, retrospectives, and PI planning events following the SAFe framework. - Guide multiple squads workin...

You are applying for the position of Senior GCP Cloud Administrator for Forbes Advisor, a part of the Forbes Marketplace initiative. As a Senior GCP Cloud Administrator, your role will involve managing and optimizing various aspects of Google Cloud Platform (GCP) to ensure efficient data management and operational practices. **Responsibilities:** - Manage and configure roles/permissions in GCP IAM by following the principle of least privileged access - Optimize Big Query service through slot assignments, SQL Queries, FinOps practices, troubleshooting critical data queries, etc. - Collaborate with various teams for efficient data management and operational practices in GCP - Create automation...

As a Cloud Platform Engineer, you will be responsible for managing various CP Services such as Cloud Run, Cloud Functions, GKE, Cloud Storage, Cloud SQL, Big Query, Cloud Spanner, VPC, Load Balancing, Cloud NAT, IAM, Secret Manager, Cloud Logging and Monitoring, Vertex AI pipelines, Cloud Build, and Artifact Registry. Your key responsibilities will include: - Experience in Terraform, GitHub, Networking, BigQuery, Bigtable, Dataflow, Cloud Storage, and other GCP Cloud Technology Services - Managing Google Compute Engine (GCE), Google Kubernetes Engine (GKE), Cloud Storage, and other Google Cloud Managed Services - Utilizing monitoring tools like Stackdriver Monitoring, Logging, Debugging, and...

As a Data Engineer at DataNimbus, you will play a crucial role in shaping a sustainable, AI-driven future by working with cutting-edge technologies and revolutionizing workflows in Data+AI solutions. Your contributions will be trusted by global businesses for their scalability, security, and efficiency, allowing you to grow personally and professionally in a culture that values curiosity and continuous learning. **Key Responsibilities:** - Design, develop, and maintain a highly scalable data warehouse solution in BigQuery. - Architect data models, schemas, and partitioning strategies for efficient query performance. - Build and maintain ETL/ELT pipelines using tools such as Dataflow, Datapro...

Job Description GCP Data Engineer / Analytics Engineer Position: GCP Data Engineer / Analytics Engineer Experience: [6–12 years – adjust as per requirement] Location: Bangalore / Hyderabad Role Overview We are looking for an experienced GCP Data Engineer with expertise in building and optimizing large-scale data pipelines, data models, and analytics solutions on Google Cloud Platform (GCP) . The ideal candidate should have hands-on experience with BigQuery, DBT, Airflow/Cloud Composer, Dataflow/Dataproc/Datafusion, Python/PySpark, SQL, and Looker to deliver scalable, reliable, and high-performing data solutions. Key Responsibilities Design, build, and manage data pipelines and ETL/ELT workfl...

Role purpose: Strong understanding of end-to-end impact assessment across all subject areas. Creating detailed data architecture documentation, including data models, data flow diagrams, and technical specifications Creating and maintaining data models for databases, data warehouses, and data lakes, defining relationships between data entities to optimize data retrieval and analysis. Designing and implementing data pipelines to integrate data from multiple sources, ensuring data consistency and quality across systems. Collaborating with business stakeholders to define the overall data strategy, aligning data needs with business requirements. Support migration of new & changed software, elabo...

Job description If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions. We are currently seeking an experienced professional to join our team in the role of Consultant ...

Job description Some careers shine brighter than others. If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions. We are currently seeking an experienced professional to...

About You: You are a numbers person with proven attention to detail. You enjoy taking data and turning into a solution. You are a troubleshooter and passionate about what you do. What You'll Do: Work with data scientists and software engineers to support data quality initiatives, data solution ideation, and implementation Work with technical and business leads to transfer global business requirements into sound solutions and implementation Share support responsibilities for implemented components What You'll Need: 3+ years of demonstrated ability with Hive, Python, Spark/Scala, SQL, etc. Google Cloud Platform Experience, Big Query, Cloud Storage, Dataproc, Data Flow, Cloud Composer, Cloud SQ...

Experience Level: 46 years Note - Video of self Introduction of 3mins. Key Responsibilities Design, build, and maintain scalable and reliable data pipelines using GCP services such as: BigQuery, Cloud Dataflow, Pub/Sub, Cloud Storage, Cloud Composer (Airflow). Implement data ingestion from diverse sources (e.g., APIs, databases, files) into cloud data lake/warehouse. Optimize data processing workflows for performance, reliability, and cost efficiency. Develop and manage ETL/ELT processes using tools like Dataform, dbt, or custom scripts. Collaborate with data scientists, analysts, and stakeholders to deliver clean, well-documented datasets. Implement data quality, governance, and observabili...

Role & responsibilities Job Summary: As a GCP Data Engineer you will be responsible for developing, optimizing, and maintaining data pipelines and infrastructure. Your expertise in SQL and Python will be instrumental in managing and transforming data, while your familiarity with cloud technologies will be considered an asset as we explore opportunities to enhance data engineering processes. Job Description: Building scalable Data Pipelines Design, implement, and maintain end-to-end data pipelines to efficiently extract, transform, and load (ETL) data from diverse sources. Ensure data pipelines are reliable, scalable, and performance oriented. SQL Expertise: Write and optimize complex SQL que...

Role Overview: You are required to work as a GCP Data Architect with a total experience of 12+ years. Your relevant experience for engagement should be 10 years. Your primary responsibilities will include maintaining architecture principles, guidelines, and standards, data warehousing, programming in Python/Java, working with Big Data, Data Analytics, and GCP Services. You will be responsible for designing and implementing solutions in various technology domains related to Google Cloud Platform Data Components like BigQuery, BigTable, CloudSQL, Dataproc, Data Flow, Data Fusion, etc. Key Responsibilities: - Maintain architecture principles, guidelines, and standards - Work on Data Warehousing...

Join Us At Vodafone, we're not just shaping the future of connectivity for our customers - we're shaping the future for everyone who joins our team. When you work with us, you're part of a global mission to connect people, solve complex challenges, and create a sustainable and more inclusive world. If you want to grow your career whilst finding the perfect balance between work and life, Vodafone offers the opportunities to help you belong and make a real impact. What you'll do Conduct end-to-end impact assessments across all subject areas for new demands. Create and maintain comprehensive data architecture documentation including data models, flow diagrams, and technical specifications. Desi...

As a GCP Data Engineer, you will play a crucial role in the development, optimization, and maintenance of data pipelines and infrastructure. Your proficiency in SQL and Python will be pivotal in the management and transformation of data. Moreover, your familiarity with cloud technologies will be highly beneficial as we strive to improve our data engineering processes. You will be responsible for building scalable data pipelines. This involves designing, implementing, and maintaining end-to-end data pipelines to efficiently extract, transform, and load (ETL) data from various sources. It is essential to ensure that these data pipelines are reliable, scalable, and performance-oriented. Your ex...

We are looking for an experienced GCP Data Engineer with 510 years of experience in Google Cloud Platform (GCP) services and Big Data Analytics solutions . This is an exciting opportunity for professionals passionate about designing and implementing scalable data engineering solutions while working on advanced cloud-based projects. Key Responsibilities:- Design, build, and optimize data pipelines using BigQuery, Dataflow, DataProc, and Cloud Composer . Implement Big Data Analytics solutions leveraging Hadoop, Hive, and Spark on GCP. Write efficient queries and scripts with SQL, PySpark, and Python for large-scale data processing. Work with orchestration and messaging tools like Airflow, Kafk...