1
Show HN: Tiny-vLLM – high performance LLM inference engine in C++ and CUDA
用C++和CUDA打造的高性能轻量LLM推理引擎，代码开源，适合自部署优化。
Article URL: https://github.com/jmaczan/tiny-vllm Comments URL: https://news.ycombinator.com/item?id=48328184 Points: 6 # Comments: 0