1
Show HN: Run GLM-4.5-Air(110B)on a 16GBRAM consumer machine
16GB内存就能运行110B大模型，量化技术让消费级硬件也能玩转前沿AI。
Article URL: https://github.com/FedericoTs/quantprobe Comments URL: https://news.ycombinator.com/item?id=49028865 Points: 1 # Comments: 0
2
How I Built a Local AI Orchestrator and City AI: My Journey as a Developer
开发者亲述如何在RTX 3050消费级显卡上打造完全离线、隐私优先的AI编排器，实现亚100ms推理速度，兼顾性能与隐私。
Hi, I'm Raj Patil (known online as Dream / lostxmusafir ), an AI Engineer and Full-Stack Developer. In this article, I want to break down how I develo…