Full Stack Engineer-JS, Python/Immediate/Remote

Day-to-Day Responsibilities

• Design, develop, and maintain efficient, high-quality code to train and optimize AI models.
• Conduct evaluations (Evals) to benchmark model performance and provide detailed analysis for continuous improvement.
• Evaluate and rank AI model responses across diverse domains, ensuring compliance with predefined criteria.
• Develop comprehensive explanations and rationales for evaluations, showcasing strong reasoning and technical depth.
• Lead 

  Supervised Fine-Tuning (SFT)

   efforts, including building and maintaining high-quality, task-specific datasets.
• Collaborate with researchers and annotators to execute 

  Reinforcement Learning with Human Feedback (RLHF)

   and refine reward models.
• Design innovative evaluation strategies and processes to enhance model alignment with user needs and ethical guidelines.
• Create and refine optimal responses to improve AI performance, emphasizing clarity, accuracy, and relevance.
• Conduct peer reviews of code and documentation, providing constructive feedback and identifying areas for improvement.
• Collaborate with cross-functional teams to enhance model performance and contribute to product features.
• Continuously explore and integrate new tools, frameworks, and methodologies to optimize AI training pipelines.

Required Skills & Qualifications

• Bachelor’s/Master’s degree in 

  Computer Science, Engineering

  , or equivalent experience.
• Strong coding proficiency in 

  Python

   and 

  JavaScript/TypeScript

  .
• Solid understanding of 

  JavaScript ES6+

  , and hands-on experience with frameworks such as:
• Backend: 

  Node.js

   or 

  NestJS

• Frontend: 

  React

  , 

  Angular

  , or 

  Vue.js

• Experience building 

  modular, scalable web applications

   with a focus on 

  readability, maintainability, and security

  .
• Experience with 

  test-driven development (TDD)

   and/or prior exposure to 

  software QA and test planning

  .
• Strong grasp of 

  Docker

   for containerization and deployment (mandatory).
• Excellent written and spoken communication skills in English.

Nice to Have

• Experience with 

  LLMs

  , including prompting in ChatGPT or similar models.
• Familiarity with 

  Reinforcement Learning

  , 

  model alignment

  , or other AI training pipelines.
• Knowledge of advanced 

  evaluation strategies

   for AI models.