Staff Data Engineer

Organization: At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things.
Job Title: Staff Data Engineer
Location: Bengaluru - Manyata Tech Park
Business & Team: You will be part of a dynamic cloud engineering team within CDAO – Data Platforms. The team is responsible for building and maintaining data processing frameworks for the bank, facilitating secure and automated data processing for various business units. The team also fosters a community of practitioners, sharing best practices and building data talent and capabilities across the organization.
Impact & Contribution: As a Staff Data Engineer within the Chief Data and Analytics Office (CDAO) – Data Platforms, you will play a pivotal role in realizing a data-driven organization for Commonwealth Bank Group. You will be part of a large cloud engineering cohort, collaborating with AWS Engineers and Cloud Architects to design, develop, and deliver scalable, federated cloud-native systems. Your work will directly contribute to building robust data processing frameworks, enabling secure and seamless data processing, and delivering enhanced data solutions with robust controls for internal customers—ultimately driving value for the bank’s customers. You will bring expertise in building scalable frameworks on cloud platforms, with a strong focus on automation and innovation.
Roles & Responsibilities:

• Design, develop, and deliver scalable, cloud-native data processing frameworks.
• Collaborate with AWS Engineers, Cloud Architects, and stakeholders to migrate on-premises frameworks and pipelines to the cloud.
• Build and maintain secure, automated data processing solutions for internal customers.
• Solve complex technical problems systematically, with a passion for cloud, DevOps, and automation
• Mentor junior developers, participate in design sessions, and conduct code reviews.
• Exhibit leadership qualities and proactively seek innovative solutions to technical challenges.
Ensure data quality and dynamic ingestion processes are robust and business-agnostic.

Essential Skills:

• 12–15 years of relevant experience in data engineering.
• Hands-on technical experience with AWS, including services such as S3, Athena, IAM Roles, Redshift, Glue, and Lake Formation with strong expertise in Pyspark and EMR.
• Proficiency in Unix Shell scripting, Python scripting, and PL/SQL.
• Experience in building scalable frameworks on cloud platforms, with a focus on automation and innovation.
• Exposure to Big Data technologies (Hadoop, Hive) and dynamic ingestion processes.
• Understanding of CI/CD pipelines and DevOps practices is desirable.
• Experience mentoring junior developers and participating in design sessions and code reviews.
Knowledge of data quality frameworks and tools such as Terraform is a plus.

Education Qualification: Bachelor’s degree/Master’s degree in Engineering in Computer Science/Information Technology.