1
Hardware LLM Taalas Reaches >14,000 TPS on Llama 3.1 8B
Taalas HC1硬件实现Llama 3.1 8B每秒1.7万tokens，突破推理速度极限，硬件加速大模型新标杆。
Article URL: https://taalas.com/products/ Comments URL: https://news.ycombinator.com/item?id=48219914 Points: 3 # Comments: 1