LLM - Senior Python

About Client:

Our client is one of the world's fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems. They helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM and frontier knowledge; and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies.Powering this growth is our clients talent cloud—an AI-vetted pool of 4M+ software engineers, data scientists, and STEM experts who can train models and build AI applications. All of this is orchestrated by ALAN—our AI-powered platform for matching and managing talent, and generating high-quality human and synthetic data to improve model performance. ALAN also accelerates workflows for model and agent evals, supervised fine-tuning, reinforcement learning, reinforcement learning with human feedback, preference-pair generation, benchmarking, data capture for pre-training, post-training, and building AI applications.

Job Title: LLM - Senior Python

Location: Pan India

Experience: 3+ yrs

Job Type : Contract to hire

Notice Period:- Immediate joiner

What does day-to-day look like:

• Design, develop, and maintain efficient, high-quality Python code to train and optimize AI models.
• Conduct evaluations (Evals) to benchmark model performance and analyze results for continuous improvement.
• Familiarity with Python frameworks and libraries
• Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria.
• Develop comprehensive explanations and rationales for evaluations, showcasing excellent reasoning and technical expertise.
• Lead efforts in Supervised Fine-Tuning (SFT), including creating and maintaining high-quality, task-specific datasets.
• Collaborate with researchers and annotators to execute Reinforcement Learning with Human Feedback (RLHF) and refine reward models.
• Design innovative evaluation strategies and processes to improve the model's alignment with user needs and ethical guidelines.
• Create and refine optimal responses to improve AI performance, emphasizing clarity, relevance, and technical accuracy.
• Conduct thorough peer reviews of code and documentation, providing constructive feedback and identifying areas for improvement.
• Collaborate with cross-functional teams to improve model performance and contribute to product enhancements.
• Continuously explore and integrate new tools, techniques, and methodologies to enhance AI training processes.

Requirements:

• 3+ years of strong experience with Python programming language concepts, including ownership, borrowing, and lifetimes
• Industry experience and knowledge of code quality, formatting, and best practices of software development
• Experience with Python’s testing ecosystem, including unit, integration, and property-based testing.
• Knowledge of multi-threading and asynchronous programming in Python.
• Ability to work with architectural patterns and refactor code without introducing regressions.
• Strong debugging skills, including fixing memory and concurrency issues.
• Fluent in conversational and written English communication skills