Python Developer

About Company:

Our client is a Palo Alto–based AI infrastructure and talent platform founded in 2018. It helps companies connect with remote software developers using AI-powered vetting and matching technology. Originally branded as the “Intelligent Talent Cloud,” they enabled companies to “spin up their engineering dream team in the cloud” by sourcing and managing vetted global talent.

In recent years, they have evolved to support AI infrastructure and AGI workflows, offering services in model training, fine-tuning, and deployment, powered by their internal AI platform, ALAN, and backed by a vast talent network. They reported $300 million in revenue and reached profitability. Their growth is driven by demand for annotated training data from AI labs, including major clients like OpenAI, Google, Anthropic, and Meta.

Sr.Python Developer

Pan India

6+ yrs.

Contract to hire

Remote

Immediate joiners

Roles and Responsibilities:

What does day-to-day look like:

• Design, develop, and maintain efficient, high-quality Python code to train and optimize AI models.
• Conduct evaluations (Evals) to benchmark model performance and analyze results for continuous improvement.
• Familiarity with Python frameworks and libraries
• Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria.
• Develop comprehensive explanations and rationales for evaluations, showcasing excellent reasoning and technical expertise.
• Lead efforts in Supervised Fine-Tuning (SFT), including creating and maintaining high-quality, task-specific datasets.
• Collaborate with researchers and annotators to execute Reinforcement Learning with Human Feedback (RLHF) and refine reward models.
• Design innovative evaluation strategies and processes to improve the model's alignment with user needs and ethical guidelines.
• Create and refine optimal responses to improve AI performance, emphasizing clarity, relevance, and technical accuracy.
• Conduct thorough peer reviews of code and documentation, providing constructive feedback and identifying areas for improvement.
• Collaborate with cross-functional teams to improve model performance and contribute to product enhancements.
• Continuously explore and integrate new tools, techniques, and methodologies to enhance AI training processes.

Requirements:

• 6+ years of strong experience with Python programming language concepts, including ownership, borrowing, and lifetimes
• Industry experience and knowledge of code quality, formatting, and best practices of software development
• Experience with Python’s testing ecosystem, including unit, integration, and property-based testing.
• Knowledge of multi-threading and asynchronous programming in Python.
• Ability to work with architectural patterns and refactor code without introducing regressions.
• Strong debugging skills, including fixing memory and concurrency issues.
• Fluent in conversational and written English communication skills