Which Tokens Do Hybrid Models Actually Predict Better?

AI2's new analysis reveals where Olmo Hybrid beats transformers token-by-token—and where attention still wins. Turns out recurrence crushes meaning-bearing words but struggles with exact copies.