Sign in Subscribe

Plain English Papers

Long Context Compression with Activation Beacon

Getting the most out of each token

Partitioning via beacons to get the most out of each token

Read next

Spongebob reading with both eyes

Making AI See Better

So hot right now... the meme format.

Chain-of-thought is so hot right now. You shouldn't always use it.

Chess game example

Get ready to lose to Transformers on Lichess

They can hit 2895 Elo … without memorizing patterns