Python LLM Developer

What does day-to-day look like:

• Design, develop, and maintain efficient, high-quality Python code to train and optimize AI models.
• Conduct evaluations (Evals) to benchmark model performance and analyze results for continuous improvement.
• Familiarity with Python frameworks and libraries
• Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria.
• Develop comprehensive explanations and rationales for evaluations, showcasing excellent reasoning and technical expertise.
• Lead efforts in Supervised Fine-Tuning (SFT), including creating and maintaining high-quality, task-specific datasets.
• Collaborate with researchers and annotators to execute Reinforcement Learning with Human Feedback (RLHF) and refine reward models.
• Design innovative evaluation strategies and processes to improve the model's alignment with user needs and ethical guidelines.
• Create and refine optimal responses to improve AI performance, emphasizing clarity, relevance, and technical accuracy.
• Conduct thorough peer reviews of code and documentation, providing constructive feedback and identifying areas for improvement.
• Collaborate with cross-functional teams to improve model performance and contribute to product enhancements.
• Continuously explore and integrate new tools, techniques, and methodologies to enhance AI training processes.

Requirements:

• 5+ years of strong experience with Python programming language concepts, including ownership, borrowing, and lifetimes
• Industry experience and knowledge of code quality, formatting, and best practices of software development
• Experience with Pythons testing ecosystem, including unit, integration, and property-based testing.
• Knowledge of multi-threading and asynchronous programming in Python.
• Ability to work with architectural patterns and refactor code without introducing regressions.
• Strong debugging skills, including fixing memory and concurrency issues.
• Fluent in conversational and written English communication skills

Evaluation Process :

Two rounds of interviews

Description:

Eligibility:

• Timings:

  8 hrs/day, Mon-Fri

Preferred candidate profile