Differential Transformers
LLMs work better when they ignore unimportant info
Read next
Netflix's VOID shows video editing has finally learned the laws of physics
By treating object removal as a causal simulation rather than a pixel-patching job, VOID eliminates "ghost" physics from edited scenes
Simplifying transformer blocks
Revisiting Transformer Architectures for Potential Efficiency Gains
