General Preference Annotator

A preference annotator without specialized domain expertise who compares responses on general criteria such as helpfulness, harmlessness, honesty and tone.

Responsibility. Provides scalable, lower-cost comparative judgments on general-purpose content.

Also known as: General annotator

Variant of Preference Annotator abstract

When to choose. Choose for general-purpose content where volume and cost matter; unsuitable for specialized medical, legal, financial or safety-critical content.