Data Engineering Engineer II

Overview

Job Title: Data Engineering Engineer II

Location: Chennai

Work Type: Hybrid

Position Description

• Employees in this job function are responsible for designing, building, and maintaining data solutions including data infrastructure, pipelines, etc. for collecting, storing, processing and analyzing large volumes of data efficiently and accurately
  

Key Responsibilities

• Collaborate with business and technology stakeholders to understand current and future data requirements
• Design, build and maintain reliable, efficient and scalable data infrastructure for data collection, storage, transformation, and analysis
• Plan, design, build and maintain scalable data solutions including data pipelines, data models, and applications for efficient and reliable data workflow
• Design, implement and maintain existing and future data platforms like data warehouses, data lakes, data lakehouse etc. for structured and unstructured data
• Design and develop analytical tools, algorithms, and programs to support data engineering activities like writing scripts and automating tasks
• Ensure optimum performance and identify improvement opportunities
  

Skills Required

• Python, Dataproc, dataflow, GCP Cloud Run,
• Agile Software Development, DataForm, TERRAFORM,
• Big Query, Data Fusion, GCP, Cloud SQL, KAFKA
  

Experience Required

• Bachelor's degree in Computer Science, Engineering, or a related technical field
• 5+ years of SQL development experience
• 5+ years of analytics/data product development experience required
• 3+ years of Google cloud experience with solutions designed and implemented at production scale
• Experience working in GCP native (or equivalent) services like Big Query, Google Cloud Storage, Dataflow, Dataproc, etc
• 2+ Experience working with Airflow for scheduling and orchestration of data pipelines
• 1+ Experience working with Terraform to provision Infrastructure as Code
• 2 + years professional development experience in Python
  

Experience Preferred

• In-depth understanding of Google's product technology (or other cloud platform) and underlying architectures
• Experience with development eco-system such as Tekton/Cloud Build, Git Experience in working with DBT/Dataform
  

Education Required

• Bachelor's Degree
  

Education Preferred

• Bachelor's Degree
  

TekWissen® Group is an equal opportunity employer supporting workforce diversity.