arXiv 人工智能· Linfei Ji (Huazhong University of Science and Technology), Jiayun Li (Tsinghua University), Haozhao Wang (Huazhong University of Science and Technology), Siyu Jiang (Huazhong University of Science and Technology), Zehao Wang (Harbin Institute of Technology), Longtao Xiao (Huazhong University of Science and Technology), Yu-Jie Yuan (Huawei Technologies Ltd), Ruixuan Li (Huazhong University of Science and Technology)·· 3 小时前AI 评分33
TeachBack：面向同策略自蒸馏的双向偏好优化教学框架
TeachBack: Learning to Teach via Bidirectional Preference Optimization for On-Policy Self-Distillation
AI 导读
研究人员提出面向同策略自蒸馏（OPSD）的双向偏好学习框架 TeachBack，不仅让模型向特权 Teacher 学习，还通过反向偏好学习 Teacher 应当如何教学。
来源：arXiv 人工智能 · arxiv.org