Local Installation Video and Testing - Step by Step
Hi,
Kudos on producing such a sublime model. I did a local installation and testing video :
https://youtu.be/fOn1p7H2CxM?si=e-1GGzsgDsVInthN
Thanks and regards,
Fahd
Awesome!
Create a google colab notebook file
Create a google colab notebook file
I encountered the error "RuntimeError: FlashAttention only supports Ampere GPUs or newer" when running it on a Google Colab T4 GPU.
Create a google colab notebook file
I encountered the error "RuntimeError: FlashAttention only supports Ampere GPUs or newer" when running it on a Google Colab T4 GPU.
FlashAttention_2 should be replaced with SDPA when creating the model. We’ve added automatic handling for this—just pull the latest changes and try again.
We’ve also released an official Colab; feel free to give it a try!