1
TraceLab: Characterizing Coding Agent Workloads for LLM Serving
首个编码智能体负载画像公开数据集,揭示LLM服务系统的长上下文与爆发性流量特征,优化推理部署必读。
arXiv:2606.30560v1 Announce Type: new Abstract: Coding agents are rapidly becoming a major application of agentic LLMs, but serving them efficiently r…