1
A system programmer's guide to LLM inference
从系统程序员视角拆解LLM推理，附真实CPU性能数据，直击量化与优化要点。
Article URL: https://blog.xiangpeng.systems/posts/how-to-llm-inference/ Comments URL: https://news.ycombinator.com/item?id=48461660 Points: 3 # Commen…
2
A wild idea: Abstract reality using ontology
用本体论抽象现实，探索降低LLM资源消耗的新思路，让大模型在CPU上飞驰
# A Wild Idea: Abstract Reality with Ontology ## Background Large language models (LLMs) debuted with GPT-3 back in June 2020. After roughly five to s…
3
I tested 8 LLM models on Linux without using the GPU
8款LLM模型无需GPU在Linux上实测，CPU推理新选择关注真实可用性
Article URL: https://itsfoss.com/testing-local-llms-without-gpu/ Comments URL: https://news.ycombinator.com/item?id=48147334 Points: 2 # Comments: 0