1
Counteraction-Aware Multi-Teacher On-Policy Distillation for General Capability Recovery with Domain Preservation
多教师蒸馏新方法,通过反作用感知策略蒸馏实现通用能力恢复并保持领域特性,为模型微调与领域延续提供新思路。
arXiv:2605.27115v1 Announce Type: new Abstract: Domain specialization can improve LLM behavior in vertical domains, but often weakens the general capa…