Mobile Engineer (Kotlin)

Role Overview:

This role involves contributing to a project with a leading foundational LLM company, focused on enhancing Large Language Models (LLMs). The primary objective is to support the development of high-quality proprietary data used for fine-tuning and evaluating LLMs.

Key Responsibilities:

Develop and maintain high-quality Kotlin code to support AI model training and optimization.

Conduct evaluations (Evals) to benchmark model performance and provide insights for improvement.

Evaluate and rank AI-generated responses across various domains based on predefined criteria.

Provide detailed rationales for evaluations, demonstrating strong reasoning and technical skills.

Lead Supervised Fine-Tuning (SFT) efforts by creating and managing task-specific datasets.

Collaborate with researchers and annotators on Reinforcement Learning with Human Feedback (RLHF) tasks.

Design and implement evaluation strategies to align models with user needs and ethical standards.

Generate and refine model responses to enhance clarity, relevance, and technical accuracy.

Perform peer reviews of code and documentation, offering constructive feedback.

Work cross-functionally to enhance model performance and contribute to product development.

Stay updated with and integrate new tools and methodologies to improve AI training workflows.

Required Skills:

3+ years of hands-on experience with Kotlin and Android development.

Strong understanding of modular development, scalable architectures, and secure coding practices.

Ability to clearly articulate logic and reasoning in code, preferably using platforms like Google Colab.

Proficiency in Kotlin syntax and conventions.

Familiarity with QA technologies is a plus.

Excellent verbal and written communication skills in English.

Evaluation Process:

Technical Interview: 1 round (60 minutes)

Delivery Interviews: 2 rounds (30 minutes each, including cultural fit discussion)

Total Duration: Approximately 90 minutes