VideoModelStudio / docs /finetrainers /documentation_optimizers.md
jbilcke-hf's picture
jbilcke-hf HF staff
upgrading our code to support the new finetrainers
d464085

A newer version of the Gradio SDK is available: 5.23.1

Upgrade

Optimizers

The following optimizers are supported:

  • torch:
    • Adam
    • AdamW
  • bitsandbytes:
    • Adam
    • AdamW
    • Adam8Bit
    • AdamW8Bit

Not all optimizers have been tested with all models/parallel settings. They may or may not work, but this will gradually improve over time.