Paper

Beyond Data Schedule: Fast LLM Pretraining on Data Mixtures by Loss-Reweighting · ByteTrail