Paper

What the Loss Curve Misses: FP4 Pretraining Slows the Acquisition of Rare Facts · ByteTrail