onnx-community

/

Qwen2.5-1.5B-Instruct

like 3

Follow

ONNX Community 393

Same! I get

Error in assessPostAlignmentInternal: RuntimeError: Aborted(). Build with -sASSERTIONS for more info.
    at ort-wasm-simd-thread….jsep.wasm:0x151e92
    at ort-wasm-simd-threaded.jsep.wasm:0x3ef6d
    at ort-wasm-simd-threaded.jsep.wasm:0x75842
    at ort-wasm-simd-threaded.jsep.wasm:0xcd4b
    at ort-wasm-simd-threaded.jsep.wasm:0x1afa0
    at ort-wasm-simd-threaded.jsep.wasm:0xa18a7
    at ort-wasm-simd-thread….jsep.wasm:0x86cd4d
    at ort-wasm-simd-thread….jsep.wasm:0x12df31

In all of the quantized onnx-community/Qwen2.5-1.5B-Instruct models I tried (onnx-community/Qwen2.5-1.5B too). I tried different options, but to no avail. Sometimes I get different assertions.

Has anyone else managed to use Qwen2.5-1.5B with transformers.js? I know it works with webllm perfectly, but I have to use transformers.js. Would be happy if anyone shared a solution.