File size: 349 Bytes
31f26ff
 
e1fa6fa
 
 
 
 
1
2
3
4
5
6
7
8
---
license: apache-2.0
---

Mistral-7b-v0.1-DPO is a finetuned adapter from the original Mistral-7b model. In this adaptor, I am finetuning the LM head in addition to the regular modules that are normally finetuned. Below is the list of the finetuned modules:
'k_proj', 'gate_proj', 'v_proj', 'up_proj', 'q_proj', 'o_proj', 'down_proj', 'lm_head'