Associate Director(DT_5)

15 - 25 Years

Job Description: Associate Director- Data Engineering

We at Pine Labs are looking for those who share our core belief - Every Day is Game day. We bring our best selves to work each day to realize our mission of enriching the world through the power of digital commerce and financial services.

Responsibilities

• Own the data engineering roadmap from streaming ingestion to analytics-ready layers.
• Lead and evolve our real-time data pipelines using Apache Kafka/MSK, Debezium CDC, and Apache Pinot.
• Architect and maintain custom-built Java/Python-based frameworks for data ingestion, validation, transformation, and replication.
• Design and manage data lakes using Apache Iceberg, Glue, and Athena over S3.
• Define and enforce data modelling standards across Pinot, Redshift and warehouse layers.
• Lead implementation and scaling of open-source BI tools (Superset) and orchestration platforms (Airflow).
• Drive cloud-native deployment strategies using ECS/EKS, Terraform/CDK, Docker.
• Collaborate with ML, product, and business teams to support advanced analytics and AI use cases.
• Mentor data engineers and evangelize modern architecture and engineering best practices.
• Ensure observability, lineage, data quality, and governance across the data stack.

What Matters In This Role

• Proven expertise in Kafka/MSK, Debezium, and real-time event-driven architectures
• Hands-on experience with Pinot, Redshift, RocksDB or noSQL DB
• Strong background in custom tooling using Java and Python
• Experience with Apache Airflow, Superset, Iceberg, Athena, and Glue
• Strong AWS ecosystem knowledge (IAM, S3, Lambda, Glue, ECS/EKS, CloudWatch, etc.)
• Deep understanding of data lake architecture, streaming vs batch processing, CDC concepts
• Familiarity with modern data formats (Parquet, Avro) and storage abstractions

Nice-to-Have:

• Exposure to dbt, Trino/Presto, ClickHouse, or Druid
• Familiarity with data security practices, encryption at rest/in-transit, GDPR/PCI compliance
• Experience with DevOps practices, GitHub Actions, CI/CD, and Terraform/Cloud Formation

What We Value In Our People

• You take the shot: You Decide Fast and You Deliver Right
• You are the CEO of what you do: you show ownership and make things happen
• You own tomorrow: by building solutions for the merchants and doing the right thing
• You sign your work like an artist: You seek to learn and take pride in the work you do