Skip to content

New KD methods, updated YAML constructors, and low-level loss support

Compare
Choose a tag to compare
@yoshitomo-matsubara yoshitomo-matsubara released this 27 Mar 03:51
· 68 commits to main since this release
6668e6a

New methods

  • Add SRD method (PRs #436, #444, #446)
  • Add Knowledge Distillation from A Stronger Teacher method (PR #433)
  • Add Inter-Channel Correlation for Knowledge Distillation method (PR #432)

YAML constructor

  • Update functions in yaml_util (PR #447)
  • Fix docstrings and add import_call_method & yaml constructor (PR #442)

Distillation/Training boxes

  • Enable auxiliary model wrapper builder to redesign input model (PR #437)

Registries

  • Add low-level registry and get functions (PR #426)

Documentation

  • Update benchmarks (PR #435)
  • Fix a typo (PR #424)

Examples

Tests

  • Add a test case for import_call_method (PR #443)
  • Add import test (PR #441)

Misc