Outcome-based Reward Model (ORM) is a method that evaluates an AI model solely based on the final answer, without checking the path taken to get there. If the result is correct, a reward is given. The calculation path, reasoning or intermediate steps play no role.
This approach has a practical advantage: it is easy to train because only the final result needs to be annotated and not every single intermediate step. For many tasks, this is sufficient, such as with simple classification, text summarisation or question-answering tasks with a clearly verifiable result. The disadvantage becomes apparent with more complex, multi-stage tasks. A model can still arrive at the correct result through a flawed or even guessed solution path. An outcome-based reward model does not recognise this difference and rewards the lucky hit just as much as a sound derivation. Over many training runs, this can lead to a model learning to rely on plausible-sounding but substantively fragile arguments, as long as the numbers add up in the end.
Demarcation
The counterpart is the Process Reward Model, which evaluates each intermediate step individually and thereby also detects flawed derivations with a coincidentally correct result. An outcome-based reward model is cheaper to train, while a process reward model provides the finer signal. Both are variants of the reward function within reinforcement learning training, not reinforcement learning itself.
AI in everyday work: Here's how to find the right start
AI assistant meets SAP Business One: Two paths out of the Versino AI shop
Sprint and Swirl: How an AI agent divides work and learns from trials
LATS: Considering several paths simultaneously with AI — and the availability check in SAP B1
ReAct and RLEF: How Artificial Intelligence Learns from Real Mistakes — and What Automated Bank Reconciliation in SAP Business One Has to Do with It
