Data Engineer - Enterprise Data Platforms

Role Overview: As a Platform Engineer at Macquarie's Enterprise Data Platform team, you will be responsible for supporting the Corporate Data Hub and the Query & Compute domain team by delivering cutting-edge solutions using AWS and Kubernetes technologies. You will play a crucial role in building and managing tools such as Starburst Presto, Spark, Redshift, DBT hosted on AWS EKS, and deploying new tools on AWS infrastructure. Your responsibilities will include automating manual tasks, improving efficiency, resolving vulnerabilities, monitoring and troubleshooting issues, and collaborating with cross-functional teams to address their data needs. Key Responsibilities: - Assist in delivering new platform capabilities leveraging AWS and Kubernetes technologies - Build and manage tools like Starburst Presto, Spark, Redshift, DBT hosted on AWS EKS - Deploy new tools on AWS infrastructure and conduct POCs to assess new technologies - Develop and implement solutions to automate manual tasks and improve efficiency - Resolve vulnerabilities to secure the platform - Collaborate with cross-functional teams to understand and address their data needs - Monitor and troubleshoot issues and resolve customer incidents Qualifications Required: - Bachelor's degree in Computer Science, Information Technology, or a related field - 3+ years of enterprise experience as a Cloud/DevOps/Data Engineer - Hands-on experience with AWS platform and its services - Hands-on experience with Kubernetes - Experience with Big Data processing technologies - Strong scripting skills in Python and Bash - Ability to support the business through effective communication skills - Ability to effectively collaborate with cross-functional teams - Passionate problem solver with a keen interest in Big Data and Cloud technologies,