ybelkada
/

tiny-mobilebertmodel

Feature Extraction

Model card Files Files and versions

ybelkada commited on Nov 24, 2022

Commit

f6a6028

·

1 Parent(s): e33fd7b

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -16,7 +16,7 @@
   "layer_norm_eps": 1e-12,
   "max_position_embeddings": 512,
   "model_type": "mobilebert",
-  "normalization_type": "no_norm",
   "num_attention_heads": 4,
   "num_feedforward_networks": 1,
   "num_hidden_layers": 24,

   "layer_norm_eps": 1e-12,
   "max_position_embeddings": 512,
   "model_type": "mobilebert",
+  "normalization_type": "layer_norm",
   "num_attention_heads": 4,
   "num_feedforward_networks": 1,
   "num_hidden_layers": 24,