Hugging Face's logo

TareksLab
/
L3.3-TRP-BASE-30-70B

Text Generation
Transformers
Safetensors
llama
mergekit
Merge
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
Tarek07 commited on
Commit
19d0a2c
·
verified ·
1 Parent(s): f4ac171

Upload folder using huggingface_hub

Browse files
Files changed (32) hide show
  1. README.md +6 -6
  2. mergekit_config.yml +4 -4
  3. model-00001-of-00030.safetensors +1 -1
  4. model-00002-of-00030.safetensors +1 -1
  5. model-00003-of-00030.safetensors +1 -1
  6. model-00004-of-00030.safetensors +1 -1
  7. model-00005-of-00030.safetensors +1 -1
  8. model-00006-of-00030.safetensors +1 -1
  9. model-00007-of-00030.safetensors +1 -1
  10. model-00008-of-00030.safetensors +1 -1
  11. model-00009-of-00030.safetensors +1 -1
  12. model-00010-of-00030.safetensors +1 -1
  13. model-00011-of-00030.safetensors +1 -1
  14. model-00012-of-00030.safetensors +1 -1
  15. model-00013-of-00030.safetensors +1 -1
  16. model-00014-of-00030.safetensors +1 -1
  17. model-00015-of-00030.safetensors +1 -1
  18. model-00016-of-00030.safetensors +1 -1
  19. model-00017-of-00030.safetensors +1 -1
  20. model-00018-of-00030.safetensors +1 -1
  21. model-00019-of-00030.safetensors +1 -1
  22. model-00020-of-00030.safetensors +1 -1
  23. model-00021-of-00030.safetensors +1 -1
  24. model-00022-of-00030.safetensors +1 -1
  25. model-00023-of-00030.safetensors +1 -1
  26. model-00024-of-00030.safetensors +1 -1
  27. model-00025-of-00030.safetensors +1 -1
  28. model-00026-of-00030.safetensors +1 -1
  29. model-00027-of-00030.safetensors +1 -1
  30. model-00028-of-00030.safetensors +1 -1
  31. model-00029-of-00030.safetensors +1 -1
  32. model-00030-of-00030.safetensors +1 -1
README.md CHANGED
@@ -1,9 +1,9 @@
1
  ---
2
  base_model:
3
  - SicariusSicariiStuff/Negative_LLAMA_70B
 
4
  - nbeerbower/Llama-3.1-Nemotron-lorablated-70B
5
  - Sao10K/L3-70B-Euryale-v2.1
6
- - TheDrummer/Fallen-Llama-3.3-R1-70B-v1
7
  library_name: transformers
8
  tags:
9
  - mergekit
@@ -23,8 +23,8 @@ This model was merged using the [SCE](https://arxiv.org/abs/2408.07990) merge me
23
 
24
  The following models were included in the merge:
25
  * [SicariusSicariiStuff/Negative_LLAMA_70B](https://huggingface.co/SicariusSicariiStuff/Negative_LLAMA_70B)
26
- * [Sao10K/L3-70B-Euryale-v2.1](https://huggingface.co/Sao10K/L3-70B-Euryale-v2.1)
27
  * [TheDrummer/Fallen-Llama-3.3-R1-70B-v1](https://huggingface.co/TheDrummer/Fallen-Llama-3.3-R1-70B-v1)
 
28
 
29
  ### Configuration
30
 
@@ -32,15 +32,15 @@ The following YAML configuration was used to produce this model:
32
 
33
  ```yaml
34
  models:
35
- - model: SicariusSicariiStuff/Negative_LLAMA_70B
36
- - model: Sao10K/L3-70B-Euryale-v2.1
37
  - model: TheDrummer/Fallen-Llama-3.3-R1-70B-v1
 
 
38
  merge_method: sce
39
  base_model: nbeerbower/Llama-3.1-Nemotron-lorablated-70B
40
  parameters:
41
- select_topk: 0.3
42
  dtype: float32
43
  out_dtype: bfloat16
44
  tokenizer:
45
- source: base
46
  ```
 
1
  ---
2
  base_model:
3
  - SicariusSicariiStuff/Negative_LLAMA_70B
4
+ - TheDrummer/Fallen-Llama-3.3-R1-70B-v1
5
  - nbeerbower/Llama-3.1-Nemotron-lorablated-70B
6
  - Sao10K/L3-70B-Euryale-v2.1
 
7
  library_name: transformers
8
  tags:
9
  - mergekit
 
23
 
24
  The following models were included in the merge:
25
  * [SicariusSicariiStuff/Negative_LLAMA_70B](https://huggingface.co/SicariusSicariiStuff/Negative_LLAMA_70B)
 
26
  * [TheDrummer/Fallen-Llama-3.3-R1-70B-v1](https://huggingface.co/TheDrummer/Fallen-Llama-3.3-R1-70B-v1)
27
+ * [Sao10K/L3-70B-Euryale-v2.1](https://huggingface.co/Sao10K/L3-70B-Euryale-v2.1)
28
 
29
  ### Configuration
30
 
 
32
 
33
  ```yaml
34
  models:
 
 
35
  - model: TheDrummer/Fallen-Llama-3.3-R1-70B-v1
36
+ - model: Sao10K/L3-70B-Euryale-v2.1
37
+ - model: SicariusSicariiStuff/Negative_LLAMA_70B
38
  merge_method: sce
39
  base_model: nbeerbower/Llama-3.1-Nemotron-lorablated-70B
40
  parameters:
41
+ select_topk: 0.30
42
  dtype: float32
43
  out_dtype: bfloat16
44
  tokenizer:
45
+ source: nbeerbower/Llama-3.1-Nemotron-lorablated-70B
46
  ```
mergekit_config.yml CHANGED
@@ -1,12 +1,12 @@
1
  models:
2
- - model: SicariusSicariiStuff/Negative_LLAMA_70B
3
- - model: Sao10K/L3-70B-Euryale-v2.1
4
  - model: TheDrummer/Fallen-Llama-3.3-R1-70B-v1
 
 
5
  merge_method: sce
6
  base_model: nbeerbower/Llama-3.1-Nemotron-lorablated-70B
7
  parameters:
8
- select_topk: 0.3
9
  dtype: float32
10
  out_dtype: bfloat16
11
  tokenizer:
12
- source: base
 
1
  models:
 
 
2
  - model: TheDrummer/Fallen-Llama-3.3-R1-70B-v1
3
+ - model: Sao10K/L3-70B-Euryale-v2.1
4
+ - model: SicariusSicariiStuff/Negative_LLAMA_70B
5
  merge_method: sce
6
  base_model: nbeerbower/Llama-3.1-Nemotron-lorablated-70B
7
  parameters:
8
+ select_topk: 0.30
9
  dtype: float32
10
  out_dtype: bfloat16
11
  tokenizer:
12
+ source: nbeerbower/Llama-3.1-Nemotron-lorablated-70B
model-00001-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6a694070c8f1e49fad958912d6fa759ddfa4c518abf0a6b2cf2bcea0262ddccc
3
  size 4672471504
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2693657aefc66372c519192f0697669690aecf1fcd4a64cd66aca583fd4fd454
3
  size 4672471504
model-00002-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6c37dc757217dedfd8a63247e2e78024b28b1ab0e972fe5043b566a769ee55f2
3
  size 4664167400
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6e4eabd33f90d3170dc78f0ba1b6f402a0d96a39683918b5d850954784057273
3
  size 4664167400
model-00003-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c75858e95210fd236c0a801b02f9ff4d6aa170c4327ad8d0451293f85d6ed24a
3
  size 4982917904
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a87bbe06fb706e7acf363676fdad58744212fd10fafd7207acdca05d91e85b83
3
  size 4982917904
model-00004-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5a7401901fac2cd7e8f5749f9e3dc17cc4f57d711cc4d6cd3abb2064aff0f5ba
3
  size 4999711736
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:03358bb9d50f09a79d2574b065cd0e55b9cb52239503e471244abf15096d9d06
3
  size 4999711736
model-00005-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6e7bfd3af9220606ff07edc405d6d965d9b1ad14ca6ce291cc5e47997dbcf1f9
3
  size 4647373576
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee34634356a66d7383c23846f3be2a7abff0aec6abbc6ca0b818c2266478234d
3
  size 4647373576
model-00006-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:cc6db726bbfa4e126b0c9e4c45b056ce578104d3f4784efe324eb161f6b4067c
3
  size 4664167400
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bbca9a50cae8fbf182981342006ebe59529c3a8577c99a3614c4b3bec01faafb
3
  size 4664167400
model-00007-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5a346a118483a48c474c6912c40d529e1485437894baf7b07b8b7cc3b42c06aa
3
  size 4664167416
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d6acede18a0cd7ea5dae9e518f7ee557b0a3cd731858a05cb70e35436dda59e2
3
  size 4664167416
model-00008-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2661608f9418dc3145d0f21356b1e6e123fe25cf3a38871a40bc58c486527b3c
3
  size 4982917904
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c9d4b81c5f404d01b973477f994a3fc5ebec3f0723d37e93351f182ace2702cc
3
  size 4982917904
model-00009-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:486003f92ee7308d9e826cf3b851326396998c04464a332268455ffb8621cb73
3
  size 4999711736
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:31f88949001e86088fa3fd27dae9f8c1cda3c13b65855a1a35836b40d1e66f2b
3
  size 4999711736
model-00010-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:be930fe8c7b09c45650a90e24c38c5e23bf6c2bf70073e66ab4a138fa27c905d
3
  size 4647373568
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c19af1d4ed15598453645ebffc837b1aec852206e848744a72a474eac8773b15
3
  size 4647373568
model-00011-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:36ae22dad60825bbbfc122f57ce0cef33048f60ffd40d419323115a16aaf0164
3
  size 4664167408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1110e2d08e922ecd210067c276704f7f8986ce5fe12780528dfd96c025dc4770
3
  size 4664167408
model-00012-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9acf89e5f2ca298b0dfefc06e4f6054a17a96b16e79516d7b49f3e9b01a27522
3
  size 4664167416
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bbf4905f39828c73ae71b71d2425701bc9e857c27c1fb7c4729a145ea7a3e323
3
  size 4664167416
model-00013-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:47472ab9cd17d0c95539e4a0a2da9a8e3bb91ed830448f1c2cba1a737ff220d2
3
  size 4982917904
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:17a1d8aefc077a90e7fbf2e544a074b38738f494b4baddf79d352f366677157a
3
  size 4982917904
model-00014-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4123b0336a04639a3ba30c46ae8a7785eb9acbfc864c3496d46e16b8bbf44e9a
3
  size 4999711728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4efc03359345091e22441dbe89af27550ae19e6a8faef0d9af4c3f465ca088d9
3
  size 4999711728
model-00015-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:154feeea70505079c6a815233d7895e056a99fe26d70ab1270e23d4c3036dedc
3
  size 4647373576
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d0041027348539f9e42de81aa66762d4a186179e6fa7a790e9232d69bc296dad
3
  size 4647373576
model-00016-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:77b41cd27acb1cea17954c1148c8ebf1d52254b7f96f0ff7acc1557f81eb0360
3
  size 4664167408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:916d6194b030550856ddc721ad6ea66540f03ec70ab7fd76c358ed12b68b2d56
3
  size 4664167408
model-00017-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e53b4704b26ac26218af2d2321e6e18c59eca5ea6213b78c6408a2b47fef9e64
3
  size 4664167416
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4c63ff96baf53c6a81b1414c1dc5574e29be63eb21cdb23c625596e3df82456f
3
  size 4664167416
model-00018-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4bcd1c4f3dc86c62b7db6ec1bfb691aded96ff66af20573504fc488596517e72
3
  size 4982917896
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:48f0bc0cd6bbebbee21e25ee013b351761392f516cf901698075d97ab442de43
3
  size 4982917896
model-00019-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c620f23827db6501a4da60e48e17d5bc862fea11cfeac3a511d2c652b6375e6b
3
  size 4999711736
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fcec83619dba0081d2fb49275798d64cfefc889bf53c1aa6ad6acb36414a4eee
3
  size 4999711736
model-00020-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:aa1944d79ea0458740ac018024e60d4bb581c1cd983a49e1528ed7ee11faba18
3
  size 4647373576
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:51853127beea9222823c2f83d106dfa082e8dcfe0d38c4d42eaad0d22968567f
3
  size 4647373576
model-00021-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:29f3c444adc6043a31bfa50a189aa1f3c9eb08eec82eaac719120a54d2d2fde5
3
  size 4664167408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:854f21d7f51715c799f382d9ccbf99918043ba322ef0922b3e7ae452604f6685
3
  size 4664167408
model-00022-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1c90876e802f50250f420fd587ca1ed1461ae8b52a0c194adf6075475cfb1cee
3
  size 4664167408
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:73c67069c887a6d34ab0257b4fc3997418e710f5f0aba07c7e1f4c53e7978e25
3
  size 4664167408
model-00023-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:beb95c331ae309528950add988b9a223d2fbcc66e6341e6230c62e397fc7a4b8
3
  size 4982917904
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7dc615cc709dc360baa1007277794a1629cb6c4acab6bd4bf0f39517e134095f
3
  size 4982917904
model-00024-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f6763ffb432436aa25cae670c9ee54f92bcaac15d5780ca568dae76da0ea2a8c
3
  size 4999711736
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dc900180b4ceac242546592d44e77c51ade0fe9c3a883ae6a0ee87f7deb77651
3
  size 4999711736
model-00025-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0d485e34afa090bd87e264769a8abc52fb6c9592ab3cf33a291be6b92f17ff45
3
  size 4647373576
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:283427da556325f182b14fabba1d16146fb9b0255cf992b721f2eca00c8eed2c
3
  size 4647373576
model-00026-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f098469416afb2bd7e8a424fbcd5ee76a1b78570ee39fe869cf2a89e89b94cbd
3
  size 4664167400
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ecb9aa2a2486385eba16c72cae9b78fca4c766f1bbebf394125f10dd4176024b
3
  size 4664167400
model-00027-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7376fc130c76c7f17f7481b805c4aa877d36313df122b08122651e2883747fc3
3
  size 4664167416
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af5d570a02e43467249b7b6f2395a058821af2730011d5ae45e5bc9465079316
3
  size 4664167416
model-00028-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1a575dc753c8ed1b6489df646850e820e40fb0fdaa7c175dec47c6f0c23ece0e
3
  size 4982917904
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dac66f3558587cbfaa10833f4d3833434004efbcb90e0b30c87241ff4427be23
3
  size 4982917904
model-00029-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ef3e3b3fe87488f99aec1ecf8591c78b26978575a894d78708df33ec59dd3d66
3
  size 4999711728
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:992572e18b2b51e7323c42b70969e37898f6dc770a1f945ea0e9f00975edde1f
3
  size 4999711728
model-00030-of-00030.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:8f888f283311f7f1f3e2220bd577eab33c2b9f4d9e2e8a2253242bc3d790e171
3
  size 1996539368
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:844b66830d146cbe1fe7c1bd0fd9304f98bc7c80ab0a11bbcaec6afc26394d7b
3
  size 1996539368