victormiller commited on
Commit
0307054
·
verified ·
1 Parent(s): d075f0d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -2
README.md CHANGED
@@ -1,8 +1,12 @@
1
  ---
2
  license: apache-2.0
3
  ---
4
- make a visual to introduce the spike we are talking about.
 
5
 
6
  <img src="k2_spike_1.png" alt="k2 spike 1"/>
7
 
8
- [follow up with eval results]
 
 
 
 
1
  ---
2
  license: apache-2.0
3
  ---
4
+ # K2 Loss Spike 1
5
+ During the first K2 training phase, we encountered two loss spikes.
6
 
7
  <img src="k2_spike_1.png" alt="k2 spike 1"/>
8
 
9
+ ## About the LLM360 Research Suite
10
+ The LLM360 Research Suite is a comprehensive set of large language model (LLM) artifacts from Amber, CrystalCoder, and K2 for academic and industry researchers to explore LLM training dynamics. Additional resources can be found at llm360.ai.
11
+
12
+