Spaces:

zaidmehdi
/

arabic-dialect-classifier

Sleeping

zaidmehdi commited on Feb 28, 2024

Commit

f838a8b

1 Parent(s): 79dc319

returning numpy array of hidden state

Files changed (1) hide show

src/utils.py CHANGED Viewed

@@ -10,7 +10,7 @@ def extract_hidden_state(input_text, tokenizer, language_model):
     with torch.no_grad():
         outputs = language_model(**tokens)
-    return outputs.last_hidden_state
 def get_metrics(y_true, y_preds):

     with torch.no_grad():
         outputs = language_model(**tokens)
+    return outputs.last_hidden_state[:,0].numpy()
 def get_metrics(y_true, y_preds):