Spaces:
Running
Running
File size: 317 Bytes
d464085 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 |
# Optimizers
The following optimizers are supported:
- **torch**:
- `Adam`
- `AdamW`
- **bitsandbytes**:
- `Adam`
- `AdamW`
- `Adam8Bit`
- `AdamW8Bit`
> [!NOTE]
> Not all optimizers have been tested with all models/parallel settings. They may or may not work, but this will gradually improve over time.
|