Data Engineer

Data Engineer

You will work closely with data scientists, analysts, and product engineers to support data-driven decision-making and product development.

Core Responsibilities

• Design, develop, and maintain scalable

  ETL/ELT pipelines

  using Python
• Build and optimize data workflows for batch and real-time processing
• Integrate data from various internal and third-party systems
• Implement data quality checks, validation, and monitoring mechanisms
• Collaborate with cross-functional teams to understand data requirements
• Maintain data warehouse models and schemas to support business intelligence tools
• Ensure adherence to data governance and security standards
• Support orchestration and scheduling of pipelines in production

Core Skillset & Technical Requirements

Python (Primary Skill)

• Strong experience writing

  production-grade Python code

  in a data engineering context
• Familiarity with

  object-oriented design

  , code modularity, and clean architecture in Python
• Solid understanding of performance optimization for data processing in Python

Key Python Libraries & Tools

• Pandas, NumPy

  – for data manipulation

• SQLAlchemy / PySpark

  – for interacting with databases or distributed computing

• Requests / HTTPX

  – for working with APIs and third-party data sources

• Pydantic / Marshmallow

  – for data validation

• Typer / Click / argparse

  – for CLI applications and script automation

• Airflow / Prefect / Dagster

  – for orchestration (Dagster experience is a

  plus

  )

• Great Expectations

  – for data validation (optional but desirable)

Data Integration Tools

• Experience with data ingestion and transformation pipelines
• Familiarity with

  Airbyte

  (desirable)

Databases & Storage

• Proficiency with

  SQL

  and experience with relational databases (e.g.,

  PostgreSQL

  , MySQL)
• Experience with cloud-native or columnar data stores like

  Amazon Redshift

  ,

  S3

  , or

  Parquet/Delta Lake

Cloud Platforms

• Preferred:

  Experience with

  AWS

  ecosystem (S3, Lambda, Glue, Redshift, etc.)
• Knowledge of cloud security best practices and IAM principles

Other Desirable Skills

• Containerization using

  Docker

• Experience with CI/CD workflows for data pipelines
• Familiarity with version control (Git) and code review processes
• Exposure to data modeling and schema design (e.g., dimensional modeling, star/snowflake schema)

Preferred Qualifications

• 4+ years of experience in data engineering or related field
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related discipline
• Strong problem-solving and communication skills
• Experience working in Agile or fast-paced startup environments