The Preference Was Only the Beginning
A preference is not only a label on what just happened. When the decision belongs to a continuing trajectory, it can also be evidence about what happens next.
Abstract
Most preference-learning systems stop at the choice.
A model produces two responses. A human selects one. The chosen response becomes positive evidence, the rejected response becomes negative evidence, and the training system moves on.
The work itself usually continues.
The selected answer may later be revised, partially retained, contradicted or abandoned. The rejected alternative may reveal a constraint that remains active long after the immediate decision. The preference is therefore not necessarily the outcome. It may be an event inside a longer trajectory.