What is the minimum amount of memory required

by mydamai - opened Sep 13, 2023

Sep 13, 2023

What is the minimum amount of memory required to run

Sep 13, 2023

Parameter size in bfloat16 is about 350GB. You need about 360GB to run generation. There's also a quantified version here

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment