Spaces:

jbilcke-hf
/

VideoModelStudio

Running

VideoModelStudio / docs /finetrainers /documentation_optimizers.md

jbilcke-hf HF staff

upgrading our code to support the new finetrainers

d464085 25 days ago

317 Bytes

	# Optimizers

	The following optimizers are supported:
	- torch:
	- `Adam`
	- `AdamW`
	- bitsandbytes:
	- `Adam`
	- `AdamW`
	- `Adam8Bit`
	- `AdamW8Bit`

	> [!NOTE]
	> Not all optimizers have been tested with all models/parallel settings. They may or may not work, but this will gradually improve over time.