Hardware Requirements to run the original model - 671B params
#185
by
EdilCamil
- opened
Hi,
Can anyone explain what are the hardware requirements for running the original model locally?
a raspberry pi should be fine imo.
I believe that’s a bit of a stretch! The H100 wouldn’t be able to run it single handedly.
a raspberry pi should be fine imo.
WHAT?
Not for the 671b params model. Maybe the 1b but I’m not sure.