woowoofv1 / adapter_config.json
letianWoowoof's picture
Create adapter_config.json
c255e3f verified
raw
history blame contribute delete
187 Bytes
peft_config = LoraConfig(
lora_alpha=16,
lora_dropout=0.05,
r=8,
bias="none",
target_modules=["q_proj", "v_proj"],
task_type="CAUSAL_LM",
)