1
EP223: Ollama vs vLLM vs SGLang
对比三大 LLM 推理框架 Ollama、vLLM 与 SGLang，理清性能与适用场景，帮你选对部署方案。
To use open-weight models on your machine, you have three main options: Ollama, vLLM, and SGLang. But each engine handles requests differently.
2
Show HN: Ollama served my 40k-context model at 4k, silently
别被Ollama悄悄缩短上下文坑了，这个小工具帮你检测真实窗口大小。
Article URL: https://github.com/Bigbonus/ollama-context-window-check Comments URL: https://news.ycombinator.com/item?id=49372235 Points: 1 # Comments:…
3
Show HN: ChatOSS – A Codex alternative for Open Source AI built on Ollama
开源AI编程工作台，本地跑模型，AI代理写代码、管看板，一站式交付
ChatOSS is built on Ollama. If you use Ollama, ChatOSS local works out of the box. ChatOSS is a GUI desktop app that has multiple agentic coding apps …
4
New OllamaMQ v0.3.0
一键管理多引擎模型加载卸载，支持安全令牌，本地AI工作流必备实用工具。
- loading / unloading models - ollama, lm-studio, vllm - optional security tokens and visibility and many more on - https://github.com/Chleba/ollamaMQ…
5
Show HN: Visual knowledge graphs using Ollama and Embeddings
用Ollama和Embeddings本地构建可视化知识图谱，开源玩法值得一试。
Article URL: https://github.com/punnerud/Local_Knowledge_Graph Comments URL: https://news.ycombinator.com/item?id=49270102 Points: 1 # Comments: 0
6
Show HN: Memcode AI goes open source with Claude Code inspired coding agent
Memcode AI开源发布：受Claude Code启发的编码代理，内置本地LSP、沙箱Shell与视觉输入，能灵活接入Ollama或OpenAI端点，值得一试。
Article URL: https://github.com/memcode-ai/memcode Comments URL: https://news.ycombinator.com/item?id=49239401 Points: 2 # Comments: 0
7
Open-Source AI Platform Orbit
自托管AI平台，Docker一键部署，本地离线运行大模型，兼顾隐私与便捷
Article URL: https://github.com/schmitech/orbit Comments URL: https://news.ycombinator.com/item?id=49134457 Points: 2 # Comments: 0
8
Voice Commander: Control Your Mac with Hey Jarvis
试试用Ollama本地跑Llama 3.2，让Mac听懂“Hey Jarvis”，免费私有还能打造45个工具。
The Problem With Cloud AI Every token costs money. Every API call adds up. And your data goes to their servers. The Local Alternative brew install oll…
9
Show HN: Hermes Notes PKB
自托管块级知识库，融合Obsidian与Capacities精髓，还支持接入本地AI，开源党狂喜。
20+ years of PKMS obsession plus big enough chops to be dangerous at vibe-coding have led to this: a full-featured, block-first personal knowledge bas…
10
Show HN: MandoCode Desktop – Native Windows AI Coding Assistant on Ollama .NET
本地AI编码助手，基于开源模型运行，可同时开启多个代理，保护代码隐私且不依赖厂商。
Quick backstory on how this version came to be: the original MandoCode is a CLI, and its UI is built with RazorConsole — Blazor components rendered in…
11
Agent and RAG for Obsidian, Need Feedback
Obsidian老用户自研Agent+RAG项目，本地Ollama驱动，求反馈及同好测试。
I just built this as a Personal/Portfolio project. I genuinely needed it, so I built it and I regularly use it. I wanted to know if anyone else who us…
12
Show HN: An interactive way to exploit an LLM without going to jail
交互式测试LLM安全防护，用多种模型模拟越狱攻击，开源可自部署
Article URL: https://github.com/joshfischer1108/jailbreak-lab Comments URL: https://news.ycombinator.com/item?id=49060776 Points: 2 # Comments: 0
13
Build a Local LLM Chatbot with Ollama and Python
手把手教你用Ollama和Python搭建本地大模型聊天机器人，零门槛运行AI
Build a Local LLM Chatbot with Ollama and Python Build a Local LLM Chatbot with Ollama and Python Imagine typing a question into your chatbot and gett…
14
Popular open source AI developer tool Ollama raises $65M, grows to nearly 9M users
开源AI工具Ollama拿下6500万美元融资，900万开发者用它轻松部署大模型
Benchmark-backed Ollama has amassed 176,000 stars, and nearly 17,000 forks on GitHub by helping developers easily run AI on their PCs.
15
Show HN: Otaku – one terminal client for Ollama, LM Studio, and MLX
一个终端搞定 Ollama、LM Studio 和 MLX，本地大模型聊天、角色扮演全支持，开源免费还带角色日志。
Article URL: https://github.com/enclavum/otaku Comments URL: https://news.ycombinator.com/item?id=48805043 Points: 1 # Comments: 0
16
CorvinOS – a self-hosted agentic OS which enforce EU AI Act 2026 by design
自托管智能体操作系统，代码级内置欧盟AI法案与GDPR合规，支持全离线运行和本地语音。
Article URL: https://github.com/CorvinLabs/CorvinOS Comments URL: https://news.ycombinator.com/item?id=48774845 Points: 1 # Comments: 0
17
Ragit – chat with any folder of documents using a local LLM
用本地大模型与文档文件夹对话的开源工具，支持RAG和Ollama
Article URL: https://github.com/ats4321/ragit Comments URL: https://news.ycombinator.com/item?id=48743123 Points: 2 # Comments: 0
18
Good article about local LLM on MacBook Air
Ollama新MLX引擎让MacBook Air本地运行LLM速度翻倍，实测效果惊人。
Article URL: https://www.xda-developers.com/ollama-new-mlx-engine-local-llm-mac-twice-fast/ Comments URL: https://news.ycombinator.com/item?id=4872989…
19
Running a Whole RAG Agent Offline: LangGraph + Ollama + Embedded Qdrant (Zero API Keys)
零API密钥搭建离线RAG代理，LangGraph+Ollama+Qdrant全栈实战，设计优雅可切换。
Most RAG tutorials open with "set your OPENAI_API_KEY ." This one doesn't need it. In Part 1 I claimed the LLM and embeddings are behind a swappable b…
20
Your Local LLM Is Not as Private as You Think
Ollama本地大模型爆严重漏洞CVE-2026-7482，堆越界读取可导致隐私泄露，隐私神话破灭
The Bleeding Llama vulnerability shows why running AI locally is not a security strategy Running an LLM locally feels like a privacy win. No cloud API…