Data Engineer

Role & responsibilities

We are looking for a highly skilled Data Engineer to design, build, and maintain a large-scale time series data platform for financial market data (OHLC, ticks, derived metrics). The role involves architecting robust data systems, optimizing storage and query performance, and building reliable data pipelines that power quantitative research, backtesting, and live trading systems.

You will work closely with quant researchers, analysts, and backend engineers to ensure data accuracy, scalability, and low-latency access across the organization.

Preferred candidate profile

- Design and maintain high-performance time series databases, on one or more DBs like InfluxDB, ClickHouse, TimescaleDB, and PostgreSQL
- Architect and manage large-scale datasets with efficient partitioning, compression, and retention policies - Build and maintain robust ETL/ELT data pipelines for OHLC and market data - Develop and maintain APIs for historical and real-time data access - Optimize query performance for research, backtesting, and live trading systems - Implement data quality checks and reconciliation for financial time series - Work with PySpark and Apache Spark for distributed data processing - Containerize and deploy services using Docker - Design fault-tolerant pipelines with monitoring and alerting - Collaborate closely with quant and trading teams

Requirements:

- Bachelors or Masters degree in Computer Science, Engineering, or related field
- 2-5 years of experience as a Data Engineer, preferably in finance or trading - Strong experience with InfluxDB, ClickHouse, TimescaleDB, and PostgreSQL - Deep understanding of time series data - Proficiency in Python - Experience with PySpark / Apache Spark - Strong API development experience - Hands-on experience with Docker - Strong understanding of production data pipelines

Good to Have:

- Experience with financial market data (equities, futures, options)
- Knowledge of streaming systems (Kafka, Redpanda, etc.) - Experience with ClickHouse performance tuning - Cloud experience (AWS/GCP/Azure) - Exposure to quant research or trading system