Paper

A Geometric Invariant of Attention Predicts Head Specialization from Weights Alone · ByteTrail