7 Composer Airflow Jobs

As a part of the team at this company, you will be responsible for driving the implementation of the defined innovation strategy through the design and architecture for analytics platform components/services utilizing Google Cloud Platform infrastructure. Your role will involve providing technical expertise to deliver advanced analytics. You will collaborate with various global IT teams to develop Big Data reference architecture patterns for data ingestion, data processing, analytics, and data science solutions. Additionally, you will drive innovation by developing proof-of-concepts and prototypes to help illustrate approaches to technology and business problems. Key Responsibilities: - Desi...

Role Overview: As a GCP Cloud Data Engineer in Kochi, your main responsibility will be to design and develop data pipelines using GCP tools such as Cloud Dataflow, Data Fusion, Pub/Sub, Dataproc, and Composer (Airflow). You will also need to focus on data modeling, warehousing, integration, performance optimization, automation, CI/CD, data governance, and security within the GCP environment. Key Responsibilities: - Build, optimize, and maintain scalable ETL/ELT pipelines using GCP tools like Cloud Dataflow, Data Fusion, Pub/Sub, Dataproc, and Composer (Airflow). - Design and implement efficient data models and schemas for BigQuery or other GCP data stores. - Ingest structured and unstructure...

1. Experience specifically in defining solution, performing POCs, Application design and development, integration migration. 2. Understanding of Google Cloud Platform technologies in the big data and data warehousing space BigQuery, pub-sub, Dataflow, Data Catalog, Composer Airflow, Complex SQL, Stored Procedures) with experience on delivering data architect solutions using BigQuery, Google data flow, Google pub sub, google cloud SQL, google compute engine, etc. Should have at least 5+ year of experience in GCP Google Cloud Platform or similar Cloud Technologies. 3. Experience in Looker with design, development, configuration setup, dashboarding and reporting techniques. 4. Experience in Dev...

You will have the opportunity to work at Capgemini, a company that empowers you to shape your career according to your preferences. You will be part of a collaborative community of colleagues worldwide, where you can reimagine what is achievable and contribute to unlocking the value of technology for leading organizations to build a more sustainable and inclusive world. Your Role: - You should have a very good understanding of current work, tools, and technologies being used. - Comprehensive knowledge and clarity on Bigquery, ETL, GCS, Airflow/Composer, SQL, Python are required. - Experience with Fact and Dimension tables, SCD is necessary. - Minimum 3 years of experience in GCP Data Enginee...

1. Experience specifically in defining solution, performing POCs, Application design and development, integration migration. 2. Understanding of Google Cloud Platform technologies in the big data and data warehousing space BigQuery, pub-sub, Dataflow, Data Catalog, Composer Airflow, Complex SQL, Stored Procedures) with experience on delivering data architect solutions using BigQuery, Google data flow, Google pub sub, google cloud SQL, google compute engine, etc. Should have at least 5+ year of experience in GCP Google Cloud Platform or similar Cloud Technologies. 3. Experience in Looker with design, development, configuration setup, dashboarding and reporting techniques. 4. Experience in Dev...

We are seeking experienced and talented engineers to join our team. Your main responsibilities will include designing, building, and maintaining the software that drives the global logistics industry. WiseTech Global is a leading provider of software for the logistics sector, facilitating connectivity for major companies like DHL and FedEx within their supply chains. Our organization is product and engineer-focused, with a strong commitment to enhancing the functionality and quality of our software through continuous innovation. Our primary Research and Development center in Bangalore plays a pivotal role in our growth strategies and product development roadmap. As a Lead Software Engineer, ...

As a GCP Senior Data Engineer/Architect, you will play a crucial role in our team by designing, developing, and implementing robust and scalable data solutions on the Google Cloud Platform (GCP). Collaborating closely with Architects and Business Analysts, especially for our US clients, you will translate data requirements into effective technical solutions. Your responsibilities will include designing and implementing scalable data warehouse and data lake solutions, orchestrating complex data pipelines, leading cloud data lake implementation projects, participating in cloud migration projects, developing containerized applications, optimizing SQL queries, writing automation scripts in Pytho...