gpt-oss-20b-mutlilingual-reasoning

Runtime error

Tonic commited on Aug 6

Commit

e382347

1 Parent(s): 757241b

fix typo in kernels community

Files changed (1) hide show

app_alternative.py CHANGED Viewed

@@ -12,7 +12,7 @@ try:
         "openai/gpt-oss-20b",
         torch_dtype="auto",
         device_map="auto",
-        attn_implementation="kernel-community/vllm-flash-attention3"
     )
     tokenizer = AutoTokenizer.from_pretrained("openai/gpt-oss-20b")

         "openai/gpt-oss-20b",
         torch_dtype="auto",
         device_map="auto",
+        attn_implementation="kernels-community/vllm-flash-attention3"
     )
     tokenizer = AutoTokenizer.from_pretrained("openai/gpt-oss-20b")