Plain English Papers Differential Transformers LLMs work better when they ignore unimportant info Can we train Transformers to focus more on what's important and less on irrelevant details? Photo by Ben Wicks / Unsplash
All LLMs use tokenization. Are we doing it totally wrong? Slashing model size by 85% while redefining how we build adaptable, efficient LLMs
