Paper

BridgeKV: Large-Model Prefill and Small-Model Decoding for LLM Inference via KV Cache Translation · ByteTrail