State over Tokens: Characterizing the Role of Reasoning Tokens

This post is a concise, adapted version of our paper, written by Mosh Levy, Zohar Elyoseph, Shauli Ravfogel, and Yoav Goldberg.