基于OpenJDK Panama FFM的Java 22低延迟本地LLM运行器，统一硬件编排与零分配ABI，线程安全C API实现零拷贝编译。
I wanted to run AI from inside the JVM. I started out with the standard REST sidecar, ripped that out to use Project Panama (Foreign Function & Memory…
零拷贝、4KB控制缓冲+10-30ns调度，为AI应用打造的高性能底层内核。
Article URL: https://github.com/nmxmxh/foundation Comments URL: https://news.ycombinator.com/item?id=48785026 Points: 3 # Comments: 0
实现零拷贝的LLM上下文分页引擎，并发压力下仅需419微秒，Rust编写安全跨越FFI边界。
Article URL: https://github.com/matheusdelgado/infinite-context Comments URL: https://news.ycombinator.com/item?id=48555259 Points: 1 # Comments: 0
一个C++23阻塞架构Web服务器凭零拷贝、对齐等技巧飙到9k req/s，揭秘OS瓶颈与优化实战
Hey HN, I've spent the last few years doing web/desktop/IoT dev and I'm currently pivoting to low-latency/Quant. I built this as an exercise to see ho…