arshiaafshani
/

Arsh-V1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

arshiaafshani commited on 19 days ago

Commit

98f690a

·

verified ·

1 Parent(s): 0578ad5

Update config.json

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -8,7 +8,7 @@
   "eos_token_id": 32000,
   "head_dim": 128,
   "hidden_act": "silu",
-  "hidden_size": 6000,
   "initializer_range": 0.02,
   "intermediate_size": 20000,
   "max_position_embeddings": 4096,

   "eos_token_id": 32000,
   "head_dim": 128,
   "hidden_act": "silu",
+  "hidden_size": 5120,
   "initializer_range": 0.02,
   "intermediate_size": 20000,
   "max_position_embeddings": 4096,