1
A private enterprise AI gateway
企业级私有AI网关，基于角色的工作区让团队协作更高效，开源且可私有化部署。
Article URL: https://github.com/astaxie/TokenHub Comments URL: https://news.ycombinator.com/item?id=48995071 Points: 1 # Comments: 0
2
Soft-to-Hard Routing in Sparse Mixture-of-Experts Models
提出一种从软路由过渡到硬路由的机制，在稀疏MoE中同时优化模型性能与计算效率。
arXiv:2605.02124v2 Announce Type: replace-cross Abstract: Softmax routing approaches hard top-1 routing as the temperature tends to zero, but the limi…
3
I Cut My LLM API Bill by 73% — Here's the Exact Optimization Playbook
73%的LLM API成本削减实战策略，从路由层到缓存策略，无需降低质量即可实现。
I Cut My LLM API Bill by 73% — Here's the Exact Optimization Playbook Running LLMs in production burns cash. Fast. When your app goes from "prototype"…