OpenMOSE
/

HRWKV7-hxa079-Qwen3-14B

Model card Files Files and versions

OpenMOSE commited on Jun 27

Commit

57ba57e

·

verified ·

1 Parent(s): 8cbd715

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -22,6 +22,7 @@ HRWKV7-hxa079-Qwen3-14B is an experimental hybrid architecture model that combin
   - 6 GQA layers (No Rope, No Position Embeddings)
 - **Hidden Dimension:** 5120
 - **Training Context Window:** 4096 tokens
 ## Technical Innovation

   - 6 GQA layers (No Rope, No Position Embeddings)
 - **Hidden Dimension:** 5120
 - **Training Context Window:** 4096 tokens
+- **Inference Context Window** 16384 tokens(100% NIAH)
 ## Technical Innovation