手把手教你用Ollama和Python搭建本地大模型聊天机器人，零门槛运行AI
Build a Local LLM Chatbot with Ollama and Python Build a Local LLM Chatbot with Ollama and Python Imagine typing a question into your chatbot and gett…
从训练营毕业生的视角，揭秘开源AI API的成本与体验，告诉你为何自建模型可能比API更贵。
Here's the thing: bootcamp Grad Explores Open-Source AI APIs: What I Learned I graduated from a coding bootcamp about six months ago, and honestly, I …
汇集开源AI工具，从模型到部署全方位避免依赖单一厂商，值得开发者收藏。
Article URL: https://github.com/sekacorn/Linux-of-Ai Comments URL: https://news.ycombinator.com/item?id=48881655 Points: 1 # Comments: 0
本地AI无需许可即可研究和部署，正快速追赶云端模型，带来自主智能的新时代，你准备好迎接了吗？
Ahmad Osman has been advocating for local AI — running models on your own computer, workstation or dedicated hardware — long before it became a major …
从Gemini迁移到自托管LLM的真实案例，揭示API服务被替代的三大隐形推力，为生产环境部署提供参考。
A while back I wrote about my terminal-inspired portfolio and the products it indexes. Two of those products lean on a language model: the portfolio t…
快速将AI模型部署为可交互的在线应用，无需操心基础设施，一键分享给团队测试，缩短项目从实验到投产的周期。
They Don't Have an AI Problem. They Have an Engineering Problem. Artificial Intelligence has never been more accessible. In just a few months, we've g…
20分钟搞定大模型推理部署，A10 GPU成本低至一杯拿铁价，甲骨文云实战教程来了。
Last month I needed to stand up a Llama 3 inference endpoint for an internal tool. The requirements were simple: OpenAI-compatible API, auto-scaling, …
DeepSeek V4系列模型现已通过Azure在Vercel AI Gateway上可用，开发者可灵活配置请求路由。
Azure is now a provider for DeepSeek V4 Pro and V4 Flash on AI Gateway . Requests to either model can route through Azure alongside the existing provi…
突破2-bit量化瓶颈，统一标量与向量量化方法，实现大模型低成本部署与推理加速。
arXiv:2606.10520v1 Announce Type: new Abstract: Post-training quantization at the 2-bit level enables low-cost deployment and inference acceleration f…
稀疏MoE大模型部署新突破：引入联盟感知策略的专家剪枝方法
arXiv:2606.09886v1 Announce Type: cross Abstract: Sparse Mixture-of-Experts (MoE) large language models achieve strong quality with low per-token comp…
手把手教你用Mac Studio搭建定制化本地AI代理，技术细节与实操经验兼具。
Article URL: https://samihonkonen.com/posts/purpose-built-local-ai-agents/ Comments URL: https://news.ycombinator.com/item?id=48473010 Points: 1 # Com…
Claude的更新如何引发连锁反应？一文讲透AI生产环境中的“爆炸半径”管理策略！
Our system did one thing, and it did it well: It turned natural-language questions into API calls. The users were analysts, account managers, and oper…
深入剖析LLM服务中永不停止的“飞行中批处理”机制，解锁推理效率提升新思路
Article URL: https://joker666.github.io/blog/2026-06-02-llm-serving-in-flight-batching Comments URL: https://news.ycombinator.com/item?id=48414773 Poi…
新方法ProjQ让大模型压缩更聪明：后训练量化与低秩适配协同去噪，缓解顺序部署的精度损失。
arXiv:2606.00494v1 Announce Type: new Abstract: Post-Training Quantization (PTQ) and Low-Rank Adaptation (LoRA) constitute the standard pipeline for e…
OpenAI前沿模型与Codex登陆AWS，企业可在现有云环境中无缝调用，加速AI应用落地。
OpenAI frontier models and Codex are now generally available on AWS, giving enterprises a new path to build with OpenAI through the AWS environments, …
轻松估算大模型推理所需GPU数量，实用计算器帮你搞定部署成本。
Article URL: https://howmanygpus.streamlit.app/ Comments URL: https://news.ycombinator.com/item?id=48325939 Points: 3 # Comments: 0
提出请求专属测试时训练状态的批处理服务方法，助力大模型高效推理部署。
arXiv:2605.28053v1 Announce Type: new Abstract: Test-time training (TTT) adapts an LLM during generation by reading and updating request-owned state, …
深入探讨DwarfStar框架下LLM推理的分布式实现，技术细节与架构设计干货满满。
Article URL: https://antirez.com/news/167 Comments URL: https://news.ycombinator.com/item?id=48267670 Points: 3 # Comments: 0