Hugging Face's logo

Spaces:
Dovakiins
/
qwerrwe
Build error

App Files Community
Doan Minh Phuong commited on
Commit
1aa4007
·
unverified ·
1 Parent(s): 8dcd40a

Fix Codellama examples (#582)

Browse files

* Fix seq_len

* Update lora.yml

* Update qlora.yml

* Update lora.yml

* Update lora.yml

* Update qlora.yml

Files changed (6) hide show
  1. examples/code-llama/13b/lora.yml +1 -1
  2. examples/code-llama/13b/qlora.yml +1 -1
  3. examples/code-llama/34b/lora.yml +1 -1
  4. examples/code-llama/34b/qlora.yml +1 -1
  5. examples/code-llama/7b/lora.yml +1 -1
  6. examples/code-llama/7b/qlora.yml +1 -1
examples/code-llama/13b/lora.yml CHANGED
@@ -15,7 +15,7 @@ dataset_prepared_path: last_run_prepared
15
  val_set_size: 0.01
16
  output_dir: ./lora-out
17
 
18
- sequence_len: 100000
19
  sample_packing: true
20
  pad_to_sequence_len: true
21
 
 
15
  val_set_size: 0.01
16
  output_dir: ./lora-out
17
 
18
+ sequence_len: 4096
19
  sample_packing: true
20
  pad_to_sequence_len: true
21
 
examples/code-llama/13b/qlora.yml CHANGED
@@ -18,7 +18,7 @@ output_dir: ./qlora-out
18
  adapter: qlora
19
  lora_model_dir:
20
 
21
- sequence_len: 100000
22
  sample_packing: true
23
  pad_to_sequence_len: true
24
 
 
18
  adapter: qlora
19
  lora_model_dir:
20
 
21
+ sequence_len: 4096
22
  sample_packing: true
23
  pad_to_sequence_len: true
24
 
examples/code-llama/34b/lora.yml CHANGED
@@ -15,7 +15,7 @@ dataset_prepared_path: last_run_prepared
15
  val_set_size: 0.01
16
  output_dir: ./lora-out
17
 
18
- sequence_len: 100000
19
  sample_packing: true
20
  pad_to_sequence_len: true
21
 
 
15
  val_set_size: 0.01
16
  output_dir: ./lora-out
17
 
18
+ sequence_len: 4096
19
  sample_packing: true
20
  pad_to_sequence_len: true
21
 
examples/code-llama/34b/qlora.yml CHANGED
@@ -18,7 +18,7 @@ output_dir: ./qlora-out
18
  adapter: qlora
19
  lora_model_dir:
20
 
21
- sequence_len: 100000
22
  sample_packing: true
23
  pad_to_sequence_len: true
24
 
 
18
  adapter: qlora
19
  lora_model_dir:
20
 
21
+ sequence_len: 4096
22
  sample_packing: true
23
  pad_to_sequence_len: true
24
 
examples/code-llama/7b/lora.yml CHANGED
@@ -15,7 +15,7 @@ dataset_prepared_path: last_run_prepared
15
  val_set_size: 0.01
16
  output_dir: ./lora-out
17
 
18
- sequence_len: 100000
19
  sample_packing: true
20
  pad_to_sequence_len: true
21
 
 
15
  val_set_size: 0.01
16
  output_dir: ./lora-out
17
 
18
+ sequence_len: 4096
19
  sample_packing: true
20
  pad_to_sequence_len: true
21
 
examples/code-llama/7b/qlora.yml CHANGED
@@ -18,7 +18,7 @@ output_dir: ./qlora-out
18
  adapter: qlora
19
  lora_model_dir:
20
 
21
- sequence_len: 100000
22
  sample_packing: true
23
  pad_to_sequence_len: true
24
 
 
18
  adapter: qlora
19
  lora_model_dir:
20
 
21
+ sequence_len: 4096
22
  sample_packing: true
23
  pad_to_sequence_len: true
24