Staff Data Engineer

Organization: At CommBank, we never lose sight of the role we play in other people's financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things.
Job Title: Staff. Data Engineer
Location: Bangalore - Manyata Tech Park
Business & Team:

RBS (HB Domain) ---Search & Find
Impact & contribution:

• You will play a pivotal role in driving business outcomes through effective data management and analysis.
• Enhancing Decision Making with Data
• Ensuring Data Security and Compliance
• Future Trends in Data Engineering

Roles & Responsibilities:

• Design and develop highly reliable and scalable data pipelines and data platforms with comprehensive test coverage.
• Collaborate with stakeholders to analyse and translate requirements to technical implementation.
• Identify and drive opportunities for continuous improvement within the team and in delivery of products.
• Provide mentoring and technical assistance to other members of the team, including more junior Data Engineers.
• Produce high quality, sustainable solutions to meet business requirements, leveraging approved delivery frameworks and by applying industry best practice.
• Provide technical governance of product delivery to ensure successful delivery and adoption. Deliver data engineering solutions aligned to core concepts of data design, preparation, transformation, and load.
• Build and implement data pipelines in distributed data platforms including warehouses, databases, data lakes and cloud lake houses to enable data predictions and models, and reporting and visualisation analysis via data integration tools and frameworks.
• Contribute to domain planning, providing guidance to ensure that technical deliveries are aligned to engineering direction and strategy.

Essential Skills:

• 12-15 years experience of relevant experience
• Hadoop, Spark, Scala/Python, Hive, SQL, AWS(Cloud), HDFS .

Education Qualifications:

• Bachelor's degree in engineering in Computer Science/Information Technology