Efficient On-Device Diffusion LLM Inference with Mobile NPU
利用移动NPU并行加速扩散大语言模型推理,为端侧AI落地提供新思路。
arXiv:2606.13740v1 Announce Type: new Abstract: Diffusion large language models (dLLMs) accelerate generation by denoising multiple tokens in parallel…
利用移动NPU并行加速扩散大语言模型推理,为端侧AI落地提供新思路。
arXiv:2606.13740v1 Announce Type: new Abstract: Diffusion large language models (dLLMs) accelerate generation by denoising multiple tokens in parallel…
突破性硬件AI:用电阻式存储器实现高效精确的神经场重建,Nature发布。
Nature, Published online: 10 June 2026; doi:10.1038/s41586-026-10646-w A co-optimized AI hardware–software system using resistive-memory computing imp…
ZeroGPU通过JSONL文件批量处理AI聊天补全任务,零配置GPU加速,大幅提升推理效率。
Running AI inference one request at a time works well for real-time product experiences. But many workloads do not need an immediate response. Data en…
提出STEAM注意力模块,通过挤压与变换操作增强特征表达,比传统机制更高效
arXiv:2412.09023v2 Announce Type: replace Abstract: Channel and spatial attention mechanisms introduced by earlier works enhance the representation ab…
多语言文本嵌入新方案ML-Embed,突破成本、语种和透明壁垒,迈向包容高效未来。
arXiv:2605.15081v1 Announce Type: cross Abstract: The development of high-quality text embeddings is increasingly drifting toward an exclusionary futu…