Issues

• Potential sign typo in formula (7) regarding Reverse KL and SKL gradients from the paper.

  jongwooko/distillm#18 · Filter by author RADLEWIS opened on Jun 29, 2026
  1

• The hugginface link in OpenWebText is broken.

  jongwooko/distillm#17 · Filter by author hyhy892 opened on Nov 4, 2025

• About lm_loss for distillm

  jongwooko/distillm#16 · Filter by author songmzhang opened on Mar 24, 2025

• cannot reproduce openllama2

  jongwooko/distillm#15 · Filter by author zhangmingjie2002 opened on Feb 5, 2025

• Problem during finetuning qwen2 models

  jongwooko/distillm#13 · Filter by author j-datta opened on Sep 16, 2024
  1

• the code of task-specific experiments

  jongwooko/distillm#6 · Filter by author wangfan120 opened on May 15, 2024