Hardware Requirements to run the original model - 671B params

#185
by EdilCamil - opened

Hi,
Can anyone explain what are the hardware requirements for running the original model locally?

a raspberry pi should be fine imo.

I believe that’s a bit of a stretch! The H100 wouldn’t be able to run it single handedly.

a raspberry pi should be fine imo.
WHAT?

Not for the 671b params model. Maybe the 1b but I’m not sure.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment