Motif-Technologies
/

optimizer

Model card Files Files and versions

optimizer / torch-ext

Commit History

fix(optimizer): resolve bug where weight decay was multiplied by wrong lr value (#5)

671b033
verified

dongseokmotif commited on 6 days ago

Support HSDP (#4)

8447fd1
verified

iamwyldecat commited on 9 days ago

fix(muon): handle un-distributed env

1f13dae

iamwyldecat commited on Jun 23

refactor(muon): change argument adam_wd to weight_decay and handle params' type

02ac540

iamwyldecat commited on Jun 23

fix(muon): free tensors that are no longer needed

64757cb

iamwyldecat commited on Jun 16

chore(muon): update comment

036642a

iamwyldecat commited on Jun 16

chore(muon): clean build and update doc

febdf5b

iamwyldecat commited on Jun 16

fix(muon): delete intermediate tensors immediately to lower peak mem usage

bdd2678

iamwyldecat commited on Jun 15

chore: initial commit

8535e80

iamwyldecat commited on Jun 15