Visualization Rastrigin AccSGD AdaBelief AdaBound AdaDelta AdaFactor AdaHessian Adai Adalite Adam AdaMax AdamG AdaMod AdamP AdamS AdamW Adan AdaNorm AdaPNM AdaShift AdaSmooth AdEMAMix ADOPT AggMo Aida Amos APOLLO ApolloDQN ASGD AvaGrad CAME DAdaptAdaGrad DAdaptAdam DAdaptAdan DAdaptLion DAdaptSGD DiffGrad FAdam Fromage FTRL GaLore Gravity GrokFastAdamW Kate Lamb LaProp LARS Lion MADGRAD MARS MSVAG Muon Nero NovoGrad PAdam PID PNM Prodigy QHAdam QHM RAdam Ranger Ranger21 ScalableShampoo ScheduleFreeAdamW ScheduleFreeRAdam ScheduleFreeSGD SGD SGDP SGDSaI SGDW Shampoo SignSGD SM3 SOAP SophiaH SRMM StableAdamW SWATS Tiger Yogi Rosenbrock AccSGD AdaBelief AdaBound AdaDelta AdaFactor AdaHessian Adai Adalite Adam AdaMax AdamG AdaMod AdamP AdamS AdamW Adan AdaNorm AdaPNM AdaShift AdaSmooth AdEMAMix ADOPT AggMo Aida Amos APOLLO ApolloDQN ASGD AvaGrad CAME DAdaptAdaGrad DAdaptAdam DAdaptAdan DAdaptLion DAdaptSGD DiffGrad FAdam Fromage FTRL GaLore Gravity GrokFastAdamW Kate Lamb LaProp LARS Lion MADGRAD MARS MSVAG Muon Nero NovoGrad PAdam PID PNM Prodigy QHAdam QHM RAdam Ranger Ranger21 ScalableShampoo ScheduleFreeAdamW ScheduleFreeRAdam ScheduleFreeSGD SGD SGDP SGDSaI SGDW Shampoo SignSGD SM3 SOAP SophiaH SRMM StableAdamW SWATS Tiger Yogi
