SRC02 — sroberts LLM-SATs — Scorecard¶
Source Information¶
| Field | Value |
|---|---|
| Title | LLM SATs FTW |
| URL | https://sroberts.io/posts/llm-sats-ftw/ |
| Authors | Scott Roberts |
| Publication | Personal blog + GitHub |
| Date | 2024 (estimated) |
| Type | Open-source tool + blog post |
Summary Ratings¶
| Dimension | Rating |
|---|---|
| Reliability | Medium |
| Relevance | High |
| Overall | Medium-High |
Rationale¶
| Domain | Assessment |
|---|---|
| Authority | Individual practitioner; not peer-reviewed |
| Methodology | Practical implementation with published code |
| Currency | Recent (2024) |
| Objectivity | Educational project, no commercial bias |
| Scope | Covers 3 of 66 SATs — limited but functional |
| Corroboration | Based on Heuer & Pherson's published SATs methodology |
Evidence Extracts¶
| Evidence ID | Summary |
|---|---|
| SRC02-E01 | Implements 3 SATs (Starbursting, ACH, Key Assumptions Check) via LLM |