Data Engineer

Job Title: Data Engineer

Location:

About the Role:

Key Responsibilities

Data Architecture & Modeling

• Design and implement

  conceptual, logical, and physical data models

  for university systems.
• Build schemas optimized for

  OLTP and OLAP

  workloads using PostgreSQL, Snowflake, BigQuery.
• Develop

  star and snowflake schema

  models for analytics and reporting.

Data Pipelines & Integrations

• Design, develop, and maintain

  robust ETL/ELT pipelines

  using Python, SQL, dbt, Airflow, Prefect, Spark, Kafka, Kinesis, or Azure Data Factory.
• Integrate data from ERP systems such as

  Workday, Banner, Peoplesoft, SAP

  , and third-party services.
• Build

  REST APIs, microservices, and streaming pipelines

  for near real-time student and administrative data.

Data Quality, Validation & Governance

• Implement

  data validation

  , anomaly detection, and monitoring frameworks.
• Build automated

  unit tests and regression tests

  for pipelines.
• Support data governance with

  Atlan, DataHub, Collibra

  , and maintain data lineage.

Infrastructure & Performance

• Deploy and maintain cloud data infrastructure on

  AWS, Azure, and GCP

  .
• Optimize database performance through

  partitioning, indexing, and query optimization

  .
• Work with DevOps teams for secure access, scalability, and high availability.

Team Collaboration

• Collaborate with

  UI/UX teams, application developers, PMs, faculty stakeholders, and leadership

  .
• Translate complex university processes (admissions, registration, housing, finance) into streamlined data workflows.

Required Skills & Qualifications

• 4+ years of professional experience as a

  Data Engineer

  (education/ERP domain preferred).
• Strong proficiency in

  Python

  for ETL and automation.
• Advanced SQL skills with experience in

  PostgreSQL, MySQL, SQL Server

  .
• Hands-on experience with cloud data warehouses:

  Snowflake, Redshift, BigQuery

  .
• Experience with ETL/ELT tools:

  dbt, Airflow, Prefect, Kafka, Spark, Dataflow

  .
• Experience integrating ERP systems:

  Banner, Workday, Peoplesoft, SAP

  .
• Strong understanding of

  data modeling

  (3NF, star schema), API integrations, and streaming systems.
• Experience with cloud platforms:

  AWS, Azure, GCP

  .
• Excellent analytical, troubleshooting, and communication skills.

Preferred Qualifications

• Experience with

  Student Information Systems

  such as Banner, CampusNexus, Peoplesoft Campus, Workday Student.
• Knowledge of

  microservices

  and

  event-driven architectures

  .
• Experience with BI tools:

  Power BI, Looker, Tableau

  .
• Understanding of

  FERPA

  , PII handling, and data privacy compliance.
• Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science, or related field.

Tech Stack

Programming

• Python, SQL

Cloud Platforms

• AWS:

  S3, Redshift, Glue, Lambda

• Azure:

  Data Factory, Synapse, Blob Storage

• GCP:

  BigQuery, Dataflow, GCS

Data Warehousing & Databases

• Snowflake, BigQuery, Redshift, PostgreSQL, MySQL, SQL Server

Orchestration & Workflow

• Airflow, dbt, Prefect, Azure Data Factory

Streaming & Integration

• Kafka, Kinesis, REST APIs, microservices

Infrastructure & DevOps

• Terraform, CloudFormation, Docker
• Cloud resource management across AWS, Azure, GCP

Data Management

• Data Modeling (3NF, Star/Snowflake)
• Data Warehousing
• Data Governance (Atlan, DataHub, Collibra)
• Data Quality & Lineage
• Data Lake Architecture

BI & Analytics (Nice to Have)

• Power BI, Looker, Tableau