R0027/2026-03-26/Q002/S02/R05¶
Specific problematic token patterns in LLMs
Summary¶
| Field | Value |
|---|---|
| Title | Problematic Tokens: Tokenizer Bias in Large Language Models |
| URL | https://arxiv.org/html/2406.11214 |
| Date accessed | 2026-03-26 |
| Publication date | 2024-06 |
| Author(s) | Not retrieved |
| Publication | arXiv preprint |
Selection Decision¶
Included in evidence base: No
Rationale: Focuses on specific problematic tokens rather than structural linguistic challenges. Tangentially relevant but lower priority.