1
Show HN: Best setup local LLM found for a 5090 (llama.cpp fork + turboquant)
RTX 5090本地部署大模型新方案:450K上下文+多模态,基于llama.cpp fork与turboquant,实测效果出色
Hi folks, I found this setup on consummer hardware that seems to have great results on local hardware. - qwen 3.6 q6 - 450 K context using turboquant …