Two small test sets for measuring whether a model returns a positive verdict under uncertainty regardless of the evidence. Neither has any reverse engineering in it, which is the point: if the skew shows up here, it isn't a quirk of a triage prompt.
| File | What it measures |
|---|---|
yes-bias.json |
Knowledge control. 12 questions whose honest answer is plainly negative, plus 3 positive controls. A capable model should affirm none of the negatives. |
yes-bias-flattery.json |
The amplifier. 16 flattery/optimism claims the model cannot possibly verify, plus 2 controls. The honest answer is always to decline. |