1
Show HN: LLMhop – A tiny, stateless router for LLMs with a NixOS module
轻量级无状态HTTP路由器，通过model字段自动转发到对应LLM推理后端，附带NixOS模块，简洁高效
LLMhop is a tiny stateless proxy for LLM inference servers. It tackles an issue I faced when trying to serve more than one local LLM at once which is …