Which Tokens Do Hybrid Models Actually Predict Better?
AI2's new analysis reveals where Olmo Hybrid beats transformers token-by-token—and where attention still wins. Turns out recurrence crushes meaning-bearing words but struggles with exact copies.
#…
Loading…