Data Engineer

#GCP dataengineer #googlecloud #BigQuery #Dataform, #Composer #Cloud Run #

Role : GCP Data Engineer

Work Location : Pune

Work Mode : Hybrid

Description:

The Data & Analytics Delivery team, within the Group Technology business function, are onboarding Local Markets on to a bespoke Google Cloud Platform (GCP) and expanding its usage to encompass other business functions and projects.

The project migrates an on prem ETL solution on to Google Cloud, covering the entire Telecoms business. Project leverages existing data repositories and rapid, agile delivery to provision Visualizations and Machine Learning, within rich digital apps. The project delivers early, tangible value and helps the Local Market to be first adopters of Next Generation solutions and technology.

Project’s key strengths are its fast delivery, world-class cloud platforms and user-friendly designs, enabling access to massive datasets in secure and fast apps.

Job Responsibility:

· This position requires a highly motivated and experienced person with ETL and database development skills. The GCP Senior Data Engineer is a software engineer specialized in data integration solutions in Google Cloud, including technologies to use and scalability of different solutions. Typically reports to the Chapter Lead.

Core competencies, knowledge, and experience:

· About 6 years of total experience in ETL, 3-4 years on Oracle Data Integrator (ODI), 1 year on GCP Big Query, Dataform, Composer, Cloud Run etc..

· Advanced English level, ability to communicate effectively in English.

· Ability to writing PL/SQL code that manage the logic of the extraction from Source to Stage to Target layers.

· Understanding of Teradata Physical model methodology, hence some understanding about historization (Type 1 and Type 2) and normalization is need.

· Writing some Python code for Composer/Apache Airflow.

· Data mapping specification writing skills.

· Experience of integration projects on large-scale environment ETL technical design, development, in-depth understanding of large-scale data e.g., DWH and their best practices and principles.

· Experience in working in multi-project and multi-programme environment

· Good communicator, Team players, Strong problem solver, demonstrate a high degree of ownership and Ability to multi-task and build solutions co-operatively

Bonus:

· Experience working in an Agile software development workplace

· Experience in CI/CD development & familiar with Jenkins

· Experience implementing Data Quality in ETL pipelines

· Has good knowledge of Telecom & BSS systems – Prepaid, Post-paid, CRM etc.

· International projects expertise