GCP,Python/Consultant Specialist

Job Description

Some careers shine brighter than others. If you re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further. HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions. We are currently seeking an experienced professional to join our team in the role of Consultant Specialist. In this role, you will: Able to Evaluate and provide technical solutions to solve a variety of complex and interdependent processes. Ensure data quality and accuracy by implementing data quality checks, data contracts and data governance processes. Collaborate with software teams and business analysts to understand their data requirements and deliver quality fit for purpose data solutions Lead the team to deliver the end-to-end solution Requirements To be successful in this role, you should meet the following requirements: Lead the design, development, and maintenance of complex applications. Good knowledge of data pipelines and workflows using Apache Airflow on GCP. Integrate and manage data from various sources into BigQuery and GCS. Write and optimize complex SQL queries for data extraction, transformation, and loading (ETL/ELT) processes. Ensure data quality and consistency across all data pipelines. Troubleshoot and resolve issues related to data pipelines and workflows. Create and maintain technical documentation for data pipelines and workflows. Mentor and guide junior data engineers, providing technical leadership and support. Lead project planning, execution, and delivery, ensuring timely and successful completion of data engineering projects. Stay up-to-date with the latest industry trends and technologies in data engineering and cloud computing Familiarity with containerization technologies like Docker and Kubernetes. Knowledge of data governance and security best practices. Experience in working with Agile methodology. Experience with CI/CD pipelines and DevOps practices