Data Engineering Engineer 2

Position Description:

Employees in this job function are responsible for designing, building, and maintaining data solutions including data infrastructure, pipelines, etc. for collecting, storing, processing and analyzing large volumes of data efficiently and accurately Key Responsibilities: 1) Collaborate with business and technology stakeholders to understand current and future data requirements 2) Design, build and maintain reliable, efficient and scalable data infrastructure for data collection, storage, transformation, and analysis 3) Plan, design, build and maintain scalable data solutions including data pipelines, data models, and applications for efficient and reliable data workflow 4) Design, implement and maintain existing and future data platforms like data warehouses, data lakes, data lake house etc. for structured and unstructured data 5) Design and develop analytical tools, algorithms, and programs to support data engineering activities like writing scripts and automating tasks 6) Ensure optimum performance and identify improvement opportunities

Skills Required:

Big Query,, GCP

Skills Preferred:

Big Query,, Artificial Intelligence & Expert Systems, Data Form, Google Cloud Platform - Big Query, Data Flow, Data proc, Data Fusion, TERRAFORM, Tek ton, Cloud SQL, AIRFLOW, POSTGRES, Airflow Py Spark, Python, API

Experience Required:

Engineer 2 Exp: 4+ years Data Engineeringwork experience

Experience Preferred:

Google cloud certification,

Additional Information :

Required Skills Bachelor's degree in a Technical Field: Computer Science, Data Science, Computational Finance, Statistics, Economics and/or Mathematics: Masters Preferred 5+ years of experience in data solution, pipeline, mart and/or warehouse development and delivery using agile development methodology Critical thinking skills to propose solutions, test, and make them a reality. 2+ years of experience in a Data Engineering Competency on a public cloud Google 2+ years Integration and Configuration Scripting in Tekton and Terraform 3+ years of experience writing complex SQL 3+ years of experience writing data solutions in Python Deep understanding of data service ecosystems including data warehouses, lakes, metadata, meshes, fabrics and analytical use cases User experience advocacy through empathetic stakeholder relationship Excellent Communication Skills, Verbal and Written, for both internal and external team members Desired Skills 5+ years Extensive knowledge and understanding of GCP offerings, bundled services, especially those associated with data operations Cloud Console, AI/ML, Python, Data form, Big Query, Data Flow, Data Fusion, Pub Sub / Kafka, Experience with Artificial intelligence concepts /ML Experience optimizing data solutions and data science/analytical workflows: re-coding/re-developing/re-factoring Data Governance concepts including GDPR (General Data Protection Regulation), CCPA (California Consumer Protection Act), Po LP and how these can impact technical architecture