RAM requirements for this models

by Ashish098765 - opened May 13, 2024

May 13, 2024

Hello,

I am using this QuantFactory/Meta-Llama-3-70B-Instruct-GGUF-v2 So how much RAM required to load this model.Because there is not mentioned RAM requirements for each quantization model

Ashish098765 changed discussion status to closed May 13, 2024

Ashish098765 changed discussion status to open May 13, 2024

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment