Platform Overview
1Buy is a revolutionary platform transforming electronics supply chain through workflows, advanced analytics, pricing intelligence, compliance tracking, and risk management. Our technology integrates global data sources, AI-driven insights, and seamless enterprise connectivity to empower businesses with unparalleled clarity, agility, and decision-making capabilities.
Position Overview
We are hiring a hands-on Data Engineering Lead with 6+ years of experience and a track record of managing at least 2 Data Engineers. You will lead a small team while still writing code, designing pipelines, and owning delivery. Your mission is to deliver clean, timely, lineage-rich data that powers analytics, AI, and customer-facing products.
What Youll Do
- Lead a small data engineering team
- Manage and mentor 23 Data Engineers through clear goals, feedback, and 1:1s
- Hire, onboard, and level up the team with code reviews, pairing, and learning plans
- Own ingestion and integration
- Run source-system analysis and negotiate data contracts with internal and external partners
- Acquire external data with agreed SLAs and quality gates
- Build batch and streaming ingestion with Airflow DAGs, Kafka topics, and Debezium CDC
- Shape models and governance
- Own & evolve schemas and metadata across MongoDB, OpenSearch, and ClickHouse
- Build transformations with dbt and Spark, including SCD Type 2 and incremental CDC models
- Populate OpenSearch and ClickHouse from MongoDB for search and analytics
- Optimize reliability and cost
- Define freshness, completeness, and accuracy SLAs with automated monitoring and alerts
- Cut cost via partitioning, clustering, compression, and tiered storage
- Publish and protect data
- Ship a clear semantic layer and BI artifacts in OpenSearch Dashboards
- Enforce GDPR and DPDP compliance, lineage capture, and role-based access controls
- Run a practical Agile process
- Shape work with Product and Analytics, estimate sanely, and keep delivery predictable
- Drive effective standups, reviews, and retros that improve outcomes
What Youll Bring
- 7+ years in data engineering or adjacent software roles, with production systems shipped
- Experience managing 2+ Data Engineers while remaining hands-on
- Strong Python skills for pipeline development and tooling
Proven Work With
- Apache Airflow for orchestration
- Dbt & Great Expectations for ELT and testing
- MongoDB for OLTP and as a primary data store
- Apache Kafka and Debezium for streaming and CDC
- ClickHouse for analytics and OLAP
- OpenSearch for vector, semantic, and full-text search
- Spark for scalable transforms
- AWS for Hosting & Services
- Solid grasp of data modeling, SCD Type 2, CDC, and event-driven designs
- Experience in Agile or scrum environments, with clear communication and pragmatic decision-making
Nice To Have
- Domain knowledge in Supply Chain or Procurement
- Experience defining and enforcing data contracts with upstream teams
- Privacy and security knowledge, including GDPR and DPDP application
- Infra as code, CI/CD for data, and observability at scale
How We Work
- Pragmatic Agile. Lightweight ceremonies, strong ownership.
- Code quality over flash. We value readable code, tests, and useful docs.
- Accountability without drama. We surface risks early and fix issues fast.
- Continuous improvement. We measure, learn, and get better every sprint.
(ref:hirist.tech)
