Freelancer- Coding Rater (Cloud)

Key Responsibilities:

• Code Generation & Refinement: Directly write, evaluate, and rewrite code to solve
  complex, real-world problems. This is not just a management role; it is a critical hands-on position. Code Validation: Develop and implement sophisticated frameworks to rate andevaluate the quality of code responses generated by our models. This includes creatingautomated test suites and benchmarks. Code Quality and Efficiency: Analyze and improve the efficiency and correctness ofboth human-written and model-generated code. Cross-Functional Collaboration: Partner with research, engineering, and productteams to integrate feedback and drive improvements in code-centric models.Required Skills and Qualifications: Role: Tech Lead / Senior Software Engineer Experience: Proven track record (7 - 10+ years) of building and shipping complexsoftware solutions.

• Languages (Priority):

Python, Java, C, C++, JavaScript: Strong proficiency in at least one of these
languages for evaluating and rewriting model-generated code in diverseenvironments. Code Evaluation: Experience in creating comprehensive test harnesses, evaluatingcode for correctness, efficiency, and security, and defining code quality metrics. GenAI Experience (Preferred): Familiarity with LLMs and the challenges of codegeneration, fine-tuning, and evaluation.

Why This Role is Critical for Our Success:

A Tech Lead with this specific skill set will be a force multiplier for our team. By combining
coding proficiency with the ability to build evaluation frameworks, this individual will:

1. Accelerate Development: Drastically reduce the time it takes to validate and refine
code-generating models.2. Ensure Quality: Guarantee that the code produced by our models is robust, secure,and production-ready.3. Drive Innovation: Provide the deep technical insights needed to solve the mostchallenging and complex GenAI code use cases.

Preferred skills:

• priority languages: Python, Java, C, C++, Javascript
  domain expertise: stem fields, data analysis / data science, data visualization
• other requirements: familiarity with web visualization platforms, data analysis libraries,SQL/databases, JSON, HTML, markdown.
•  seniority: tech lead level - we are seeing increasing demand for smaller datasets with high complexity.

We could also be interested in "technical raters" that are not properly coders but have expertise on Javascript/JSON, HTML and markdown. We sometimes get tasks that are good fits for the super raters if not for the fact that they include some JSON or HTML for formatting output that they are not familiar with.