Llamav2 7B required 24GB System RAM or 24GB GPU RAM ?
#2
by
Tapendra
- opened
Hello sir,
Is it possible to train the "llamav2 7b" model on a custom dataset using Google Colab Pro, which offers approximately 32 GB of system RAM and 16 GB of GPU RAM?
Tapendra
changed discussion title from
Llamav2 7B required 24GB System RAM or GPU RAM ?
to Llamav2 7B required 24GB System RAM or 24GB GPU RAM ?
of course you can. I trained the 7b model on Tesla T4.