Skip to content

Add autorestart
Compare
Choose a tag to compare
@OverLordGoldDragon OverLordGoldDragon released this 08 Jul 00:35
· 8 commits to master since this release
v1.35
29aa8f2
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

FEATURE: autorestart option which automatically handles Warm Restarts by resetting t_cur=0 after total_iterations iterations.

  • Defaults to True if use_cosine_annealing=True, else False
  • Must use use_cosine_annealing=True if using autorestart=True

Updated README and example.py.

Assets 2
Loading