Fully finetune on Q, V (enc, dec, cross) matrices
Lee
Speeeed
·
AI & ML interests
None yet
Recent Activity
liked
a dataset
20 days ago
trl-internal-testing/hh-rlhf-helpful-base-trl-style
upvoted
a
paper
2 months ago
Rethinking the shape convention of an MLP
liked
a model
4 months ago
facebook/multi-token-prediction
Organizations
None yet
models
61
Speeeed/Gemma-2-2B-hella_attn_random10_portion5_lr5e-5
Text Generation
•
3B
•
Updated
•
5
Speeeed/Gemma-2-2B-hella_attn_random10_portion5_lr3e-5
Text Generation
•
3B
•
Updated
•
6
Speeeed/Gemma-2-2B-hella_attn_random10_portion5_lr1e-4
Text Generation
•
3B
•
Updated
•
3
Speeeed/flan-t5-large-piqa_lora-16
0.8B
•
Updated
•
10
Speeeed/flan-t5-large-boolq_lora-16
0.8B
•
Updated
•
7
Speeeed/flan-t5-large-hella_lora-16
0.8B
•
Updated
•
3
Speeeed/flan-t5-large-agnews_lora-16
0.8B
•
Updated
•
2
Speeeed/flan-t5-large-imdb_lora-16
0.8B
•
Updated
•
4
Speeeed/flan-t5-large-finance_lora-16
0.8B
•
Updated
•
3
Speeeed/Llama-3B-Instruct_dolly_full_qkvo_ft
Updated
datasets
0
None public yet