Curious about model design

#2
by surya-narayanan - opened

Hi,

How do you merge two models? It says on your model card that your model is the merge of llama and gpt. I'm curious how you do that?

Surya

I am very curious, too. @lilloukas , did you merge the alpaca-lora-30b adapter into the Platypus-30B model?

garage-bAInd org

We merge the alpaca lora adapter onto the Platypus-30B model using PEFTs merge_and_unload function. There's a file for this in the GitHub repo!

arielnlee changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment