Product Development Engineer I (HITL)

Phenom

Our purpose is to help a billion people find the right work! Phenom is an AI-Powered talent experience platform that is redefining the HR tech space. We have grown into a global organization with offices in 6 countries and over 1,500 employees. As an HR tech unicorn organization, innovation and creativity is within our DNA. Come help us make every talent moment Phenomenal! 

We are looking for a HITL Engineer with strong analytical and troubleshooting skills to support the operation and improvement of our Human-in-the-Loop systems. You will be responsible for monitoring workflows, identifying anomalies, debugging integration/ML feedback loops, and collaborating with cross-functional teams to ensure smooth execution of HITL pipelines.

Key Responsibilities:

• Monitor and analyze HITL pipelines for errors, bottlenecks, and anomalies.
• Troubleshoot issues across data ingestion, model inference, human validation, and feedback loops.
• Debug failures in integration flows, APIs, or job orchestration within the loop.
• Work closely with data engineers, ML engineers, and HITL operators to ensure timely issue resolution.
• Document recurring problems and propose automation or tooling to reduce manual interventions.
• Provide feedback to improve semantic models, ontology coverage, and annotation quality.
• Support the design of dashboards and alerts to track HITL metrics (latency, accuracy, throughput, error rates).

Required Skills & Qualifications:

• Bachelor’s degree in Computer Science, Information Systems, or equivalent.
• Strong debugging and log-analysis skills .
• 2+ years of experience in data pipelines, API integrations, or ML/HITL support.
• Working knowledge of databases (SQL/NoSQL) and message queues (Kafka, RabbitMQ, or similar).
• Ability to create troubleshooting playbooks and train new team members.
• Understanding of cloud platforms (AWS, GCP, or Azure).

Preferred / Nice-to-Have:

• Background in HR Tech integrations or SaaS integrations (ATS, assessments, background checks, onboarding).
• Familiarity with HITL workflows (data labeling, human validation, annotation, model retraining loops).

Benefits

We want you to be your best self and to pursue your passions!

• Benefits/programs to support holistic employee health
• Flexible hours and working schedules
• Growing organization with career pathing and development opportunities
• Tons of perks and extras in every location for all Phenoms!

Diversity, Equity, & Inclusion

Our commitment to diversity runs deep! Diversity is essential to building phenomenal teams, products, and customer experiences. Phenom is proud to be an equal opportunity employer taking collective action to build a more inclusive environment where every candidate and employee feels welcomed.

We recognize there is more to be done. Our teams are committed to continuous improvement until these powerful ideas are ingrained in our culture for Phenom and employers everywhere!