Dataflow,Bigquery,Pub/Sub,GCS & Cloud composer/Consultant Specialist

Job Description

In this role, you will: Be a part of the multiskill POD which is responsible for feature as well as technical delivery. Responsible for development of data pipeline/ database /microservice/ dataflow job with focus on high quality code. Performing requirement analysis Develop high quality and details low level designs. Participate in code review of other developers and provide feedback. Establish coding best practices and implement the same to ensure quality. Participate in the refinement session, understand the change / story, perform AS IS analysis and come up with technical implementation. Collaborate with test team to get the code thoroughly tested. Requirements To be successful in this role, you should meet the following requirements: 5+ years of overall development experience in data engineering space. Desing, build and maintain scalable and efficient data pipeline using Apache Beam. Experience in building real-time and batch Google cloud dataflow pipeline using Java. Leverage GCP services such as Dataflow, Bigquery, Pub/Sub,GCS and Cloud composer etc. for data processing and orchestration Experience in writing optimized sql. Optimize data pipelines for performance, scalability and cost efficiency. Collaborate with cross-functional teams to understand data requirements and translate them into technical solutions. Follow best practices for coding, testing and deploying data engineering solutions. Mentor junior team engineer, review code and contributing to team s technical growth. Good to have knowledge on Kakfa. Good to have knowledge of APIs and knowledge of microservices architecture. Strong hands-on experience in core java, java8/11/17 Should be aware of different logging mechanism and exception handling. Should be familiar with different code quality tools. Strong analytical and trouble shooting skills. Strong interpersonal skills and ability to work in a team and in global environments. Should be proactive, have learning attitude & adjust to work in dynamic work environments. You ll achieve more when you join HSBC.