Paper

Asymptotic Optimality of $cμ$-Rule for LLM Inference Scheduling under Memory Constraint · ByteTrail