C009¶


Research	R0055 — RLHF Yes-Men Claims
Run	2026-04-01
Claim	C009

Claim: RLVR only works in domains where correctness is objectively verifiable (mathematics, code execution)

BLUF: Partially correct but overstated. RLVR has primarily demonstrated success in math and code, but 'only works' is too strong. Research is actively extending RLVR to other domains, and the limitation is about current application, not fundamental impossibility. Only 60.3% of math problems are verifiable by rule-based methods.

Probability: Likely (55-80%) | Confidence: Medium

Summary¶

Entity	Description
Claim Definition	Claim text, scope, status
Assessment	Full analytical product with reasoning chain
ACH Matrix	Evidence x hypotheses diagnosticity analysis
Self-Audit	ROBIS-adapted 5-domain audit

Hypotheses¶

ID	Hypothesis	Status
H1	Claim is accurate as stated	Inconclusive
H2	Claim is partially correct or correct with caveats	Supported
H3	Claim is materially wrong	Eliminated

Searches¶

ID	Target	Results	Selected
S01	RLVR limitations domains mathematics code only	10	2

Sources¶

Source	Description	Reliability	Relevance
SRC01	RLVR domain research	High	High

Revisit Triggers¶

Successful RLVR applications in non-verifiable domains