CDP Treasure Data- Data Engineer

5 year minimum experience in CDP Treasure Data required

Role Description

This is a 6 month contractual remote role for a CDP Treasure Data- Data Engineer at Coredata Consultancy. The Data Engineer will be responsible for tasks such as data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics.

Key Skills:

·     Hands-on experience with ELT/ETL tools/language

·     Hands-on experience in Presto, Hive, and Digdag

·     Critical Thinking and Problem Solving

·     Data Management, Querying & Analysis

·     Good Communication

·     Experience with Treasure Data (highly desired)

Work Activities:

The resources will be expected to support the following work activities:

Data Collection & Ingestion into CIH (Customer Interaction History) Stage layer

·     Pull data extracts from S3

·     Incremental ingestion load (S3 to TD-stage layer)

·     Historical load ingestion (S3 to TD-stage layer)

·     Ingestion of Third-Party Files from S3

·     Ingestion of data into CIH via Direct connections (Braze, Meta, etc.)

Data Processing & Transformation (Workbench & Feature Development)

·     Golden Layer (GL) Workbench development

·     Creation of Attributes and behavior

·     System/Integration Testing

·     GL Workbench Code Review and Release Management

Web Unification Workflow Development

·     System/Integration Testing

·     Unification Code Review and Release Management

Parent Segment Management

·     Parent segment configuration & Design

·     Attributes and behavior field value validation

·     System/Integration Testing

·     Parent Segment Code Review and Release Management

Transition production processes to OPS team

·     Document SOPs

·     Conduct KT sessions with Operations team(s)

Sending Data from CIH to other systems/vendors

·     Sending data from CIH to Cloud data warehouse

·     Sending extracts to Vendors (e.g., IQuanti) via SFTP

Erasure & Privacy

·     Data obfuscation workflow run/updates (weekly, for new data sets)

·     Support GDPR Compliance activities

·     Support marketability requests

Enhancements & Defects Fixes

·     Ongoing Engineering work

·     Fixing Defects

• ·     Building/Enhancing monitoring/alerting frameworks