跳到正文
arXiv cs.AI· Linfei Ji (Huazhong University of Science and Technology), Jiayun Li (Tsinghua University), Haozhao Wang (Huazhong University of Science and Technology), Siyu Jiang (Huazhong University of Science and Technology), Zehao Wang (Harbin Institute of Technology), Longtao Xiao (Huazhong University of Science and Technology), Yu-Jie Yuan (Huawei Technologies Ltd), Ruixuan Li (Huazhong University of Science and Technology)·· 2 小时前AI 评分33

TeachBack:面向在线策略自蒸馏的双向偏好优化教学方法

TeachBack: Learning to Teach via Bidirectional Preference Optimization for On-Policy Self-Distillation

AI 导读

华中科技大学等机构提出 TeachBack,一种用于在线策略自蒸馏(OPSD)的双向偏好学习框架,让学生模型不仅从 Teacher 学习,也学习 Teacher 应如何教学。

来源:arXiv cs.AI · arxiv.org