按照model card的配置run不起来

by dongxq - opened Mar 30, 2024

Mar 30, 2024

/bitsandbytes/functional.py", line 1017, in dequantize_4bit
    absmax = quant_state.absmax
AttributeError: 'list' object has no attribute 'absmax'

dongxq

Mar 30, 2024

原来是bitsandbytes的版本不对，pip install "bitsandbytes<0.41.2" 解决

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment