Associate Data Engineer

Role & responsibilities

Understand the Product end-to-end and keep updating on the new features introduced to the product Develop the data pipeline solution on each stage of data acquisition, data processing, data storage and data delivery.

Design, develop and deploy robust data pipelines by retrieving data from multiple data systems

Responsible for technical design, development, testing, delivery and support of the data pipeline solution.

Work closely with technical and business stakeholders, architects on the business requirements and technical discussions and reviews.

Documenting the technical decision, solutions approach and data flows.

Perform code review and manage, track and document changes to code with source control tools.

The above statements are a snapshot of the role and are not intended to be an exhaustive list of all duties and responsibilities required.

Preferred candidate profile

Strong in Python, Structure Query Language (SQL).

Knowledge and experience in implementing the batch and streaming Data pipeline architecture

Has experience in AWS Data services and architecture.

Technical Expertise in ETL/ELT pipelines design, data storage and data management.

Managing the cloud infrastructure of data platforms.

Excellent in writing highly performing SQL, Stored procedures, Functions, and Views.

Expertise in RDBMS concepts and excellent in OLTP & OLAP SQL Commands, DB storage, retrieval and optimisation techniques.

Knowledge of RESTful APIs

Excellent communication skills

0 - 2 years of experience in software development and designing data and reporting systems.

Work Experience on the AWS data stack ( for experienced candidate).