Ensemble Reward Scorer

A reward scorer that combines scores from multiple independent reward models trained on different data or with different architectures into one reward signal.

Responsibility. Produces a reward that a policy can only exploit by fooling several reward models simultaneously.

Also known as: Ensemble reward models

Variant of Reward Scorer abstract

When to choose. Choose when reward hacking via single-pattern exploitation is a concern and the cost of training multiple reward models is acceptable.