突破2-bit量化瓶颈，统一标量与向量量化方法，实现大模型低成本部署与推理加速。
arXiv:2606.10520v1 Announce Type: new Abstract: Post-training quantization at the 2-bit level enables low-cost deployment and inference acceleration f…
深入剖析LLM服务中永不停止的“飞行中批处理”机制，解锁推理效率提升新思路
Article URL: https://joker666.github.io/blog/2026-06-02-llm-serving-in-flight-batching Comments URL: https://news.ycombinator.com/item?id=48414773 Poi…
提出请求专属测试时训练状态的批处理服务方法，助力大模型高效推理部署。
arXiv:2605.28053v1 Announce Type: new Abstract: Test-time training (TTT) adapts an LLM during generation by reading and updating request-owned state, …