Skip to content

R0055/2026-04-01/C026/SRC01

Research R0055 — RLHF Yes-Men Claims
Run 2026-04-01
Claim C026
Search S01
Result S01-R01
Source SRC01

SEI CaTE documentation

Source

Field Value
Title CaTE Guidebook and SEI publications
Publisher Various
Author(s) Various
Date 2024-2026
URL https://www.sei.cmu.edu/documents/6204/CaTE_Guidebook.pdf
Type Technical documentation

Summary

Dimension Rating
Reliability High
Relevance Medium
Bias: Missing data Low risk
Bias: Measurement Low risk
Bias: Selective reporting Low risk
Bias: Randomization N/A — not an RCT
Bias: Protocol deviation N/A — not an RCT
Bias: COI/Funding Low risk

Rationale

Dimension Rationale
Reliability High — Technical documentation from established source
Relevance Medium — directly addresses the claim
Bias flags No significant bias concerns identified

Evidence Extracts

Evidence ID Summary
SRC01-E01 CaTE focuses on measuring trust and evaluating AI systems, not constraining output behavior; no sycophancy work found