LLM Evaluator & Grader

This project is aimed at improving LLM engines, providing more accurate answers to the queries generated by users.

Main requirements:

• Being a native speaker of one of the locales included on the job page
• Being fluent in English
• Passing the required certifications

Project details:

This project will consist of three different approaches called “workflows”:

• Workflow 1: Participants will evaluatethe quality of automatically generated translations, assigning grades from 0 to 6 (according to provided instructions).
• Workflow 2: Participants will annotate errors by selecting spans of words with their corresponding issue type and severity.
• Workflow 3: Participants will evaluate and/or decide if the responses generated by a LLM (large language model) are accurate and appropriate.

About OneForma

OneForma is part of Centific, a global digital and technology services company. We bring together data, intelligence and experiences to deliver human-centric solutions to complex business challenges.