1
EnerInfer: Energy-Aware On-Device LLM Inference
端侧大模型推理的能耗难题有了新解法，EnerInfer提出能源感知优化框架，兼顾性能与功耗，适合部署在手机等边缘设备。
arXiv:2606.23001v1 Announce Type: cross Abstract: On-device LLM inference is increasingly attractive for privacy-preserving, reliable, and cost-effect…