Sun Composer

Data Engineer

About the Role

We are looking for a Data Engineer to design, build, and optimise data pipelines and infrastructure to support analytics, reporting, and business intelligence initiatives. This role focuses on enabling reliable data flow, ensuring data quality, and supporting data-driven decision-making across the organisation.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL processes
• Build and optimise data infrastructure and data warehousing solutions
• Collaborate with analysts, data scientists, and stakeholders to understand data needs
• Manage structured and unstructured data from multiple sources
• Implement data quality checks, validation, and governance practices
• Automate data workflows and support real-time data access
• Monitor performance and ensure system reliability
• Develop documentation and maintain data engineering best practices

Required Skills & Qualifications

• Bachelor’s degree in Computer Science, Data Engineering, IT, or related field
• Strong experience with SQL and data modelling
• Proficiency in Python, Scala, or Java for data processing
• Hands-on experience with ETL tools and data pipeline frameworks
• Knowledge of cloud platforms (AWS, Azure, or GCP)
• Understanding of data warehousing concepts (e.g., Snowflake, Redshift, BigQuery)
• Ability to work with APIs, databases, and large datasets
• Strong problem-solving and analytical skills

Preferred Skills

• Experience with big data technologies (e.g., Spark, Hadoop)
• Familiarity with containerisation (Docker) and version control (Git)
• Knowledge of workflow orchestration tools (Airflow, Prefect, Jenkins)
• Experience with CI/CD for data solutions
• Understanding of data security and compliance standards

What You Will Gain

• Exposure to modern data architecture and cloud technologies
• Opportunity to work alongside data analysts and data scientists
• Career growth towards Senior Data Engineer or Data Architect roles
• Hands-on experience in data lifecycle management