Paper

NarrowSpec: Draft Hidden Width Need Not Match the Target in Speculative Decoding · ByteTrail