A Simple Geometric Fix to Transformer Attention Cuts Perplexity 14.5% — By Making Similarity Care About Distance, Not Just Direction

A Simple Geometric Fix to Transformer Attention Cuts Perplexity 14.5% — By Making Similarity Care About Distance, Not Just Direction | BedrockNews