Software Development Engineer- LLM

UshtaTe

UshtaTe

prestigious clients

Job Description:-

Critically analyze and evaluate code responses generated by our LLMs across various programming languages and paradigms

• Exercise expert judgment to select the most appropriate and efficient code solutions from multiple LLM-generated options
• Develop and write coding demonstrations to illustrate "what good looks like" in AI-generated code, setting benchmarks for quality and efficiency
• Provide detailed feedback and explanations for your evaluations, helping to refine and improve the LLM's understanding and output
• Collaborate with the AI research team to identify areas for improvement in the LLM's coding capabilities
• Stay abreast of the latest developments in software engineering, coding standards, and AI to ensure our evaluations remain cutting-edge

Previous experience working with or evaluating AI systems, particularly in the context of code generation 

This role requires a unique blend of technical expertise, critical thinking, and communication skills. You will be the bridge between advanced AI technology and practical, real-world coding applications. Your work will directly influence the development of next-generation AI coding assistants, shaping the future of software development.