1
Ekka: Automated Diagnosis of Silent Errors in LLM Inference
自动诊断LLM推理中的静默错误，提升系统可靠性的新方法。
arXiv:2606.04594v1 Announce Type: cross Abstract: LLM serving frameworks are quickly evolving with a complex software stack and a vast number of optim…