A simple fix for LLM tail latency
对话遇长时间沉默?根因在LLM尾部延迟。一个简单修复方案,直击响应不稳痛点,告别通话卡壳。
Article URL: https://engineering.myhoai.com/posts/a-simple-fix-for-llm-tail-latency/ Comments URL: https://news.ycombinator.com/item?id=49278732 Point…
对话遇长时间沉默?根因在LLM尾部延迟。一个简单修复方案,直击响应不稳痛点,告别通话卡壳。
Article URL: https://engineering.myhoai.com/posts/a-simple-fix-for-llm-tail-latency/ Comments URL: https://news.ycombinator.com/item?id=49278732 Point…
用户亲测GPT-Live:对话流畅惊艳却暴露知识短板,谈Docker时的反常回答引思考
For me it's been ambivalent: It's conversational skills are an incredible leap from its predecessor: The acknowledgments it makes, and the natural flo…
OpenAI 新一代语音模型更少打断、更会倾听,对话感直追真人交流。
OpenAI is overhauling ChatGPT's voice mode with a new model that it says is more like "talking to another person." The new GPT-Live-1 is designed to i…
AI代理的冷邮件竟比真人更懂我?一场意外的有效对话,揭示AI营销新可能。
Article URL: https://julien.danjou.info/blog/an-ai-agent-emailed-me/ Comments URL: https://news.ycombinator.com/item?id=48626365 Points: 1 # Comments:…
ChatGPT新增记忆功能,如“梦境”般记住偏好,让跨对话的上下文更连贯贴心。
ChatGPT introduces a new memory system to better remember preferences, keeping context fresh and relevant across conversations.
Claude在帮用户选酒店时“闹情绪”,一句引用暴露AI拟人化边界,引发热议。
Today I was using Anthropic’s Claude Sonnet 4.5 to search and discuss hotel options for my 25th Wedding Anniversary and I wanted to pick the right one…