DavidAU commited on
Commit
7d03638
·
verified ·
1 Parent(s): 278c2b0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +40 -0
README.md CHANGED
@@ -108,6 +108,46 @@ In this case the enhancements do not have as strong effect at using "system prom
108
 
109
  Copy and paste EXACTLY as noted, DO NOT line wrap or break the lines, maintain the carriage returns exactly as presented.
110
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
111
  <PRE>
112
  Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities.
113
 
 
108
 
109
  Copy and paste EXACTLY as noted, DO NOT line wrap or break the lines, maintain the carriage returns exactly as presented.
110
 
111
+ <B>Settings, Quants and Critical Operations Notes:</b>
112
+
113
+ Change in temp (ie, .4, .8, 1.5, 2, 3 ) will drastically alter output.
114
+
115
+ Rep pen settings will also alter output too.
116
+
117
+ This model needs "rep pen" of 1.02 or higher.
118
+
119
+ For role play: Rep pen of 1.05 to 1.08 is suggested.
120
+
121
+ Raise/lower rep pen SLOWLY ie: 1.011, 1.012 ...
122
+
123
+ Rep pen will alter prose, word choice (lower rep pen=small words / more small word - sometimes) and creativity.
124
+
125
+ To really push the model:
126
+
127
+ Rep pen 1.05 or lower / Temp 3+ ... be ready to stop the output because it may go and go at these strong settings.
128
+
129
+ Longer prompts vastly increase the quality of the model's output.
130
+
131
+ QUANT CHOICE(S):
132
+
133
+ Higher quants will have more detail, nuance and in some cases stronger "emotional" levels. Characters will also be
134
+ more "fleshed out" too. Sense of "there" will also increase.
135
+
136
+ Q4KM/Q4KS are good, strong quants however if you can run Q5, Q6 or Q8 - go for the highest quant you can.
137
+
138
+ This repo also has 3 "ARM" quants for computers that support this quant. If you use these on a "non arm" machine token per second will be very low.
139
+
140
+ IQ4XS: Due to the unusual nature of this quant (mixture/processing), generations from it will be different then other quants.
141
+
142
+ You may want to try it / compare it to other quant(s) output.
143
+
144
+ Special note on Q2k/Q3 quants:
145
+
146
+ You may need to use temp 2 or lower with these quants (1 or lower for q2k). Just too much compression at this level, damaging the model. I will see if Imatrix versions
147
+ of these quants will function better.
148
+
149
+ Rep pen adjustments may also be required to get the most out of this model at this/these quant level(s).
150
+
151
  <PRE>
152
  Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities.
153