---
license: mit
datasets:
- rhyliieee/notes-completion-set
base_model:
- aaditya/Llama3-OpenBioLLM-8B
pipeline_tag: text-generation
library_name: transformers
---
Finetuned a pretrained Model with Lora, then applied Merge and Unload to Merge Peft Model with the Base Model.
Precision of Base Model is converted into half precision before Merging.

"""
# convert peft_model to half precision
peft8 = peft_model.half()

# merge peft model with base model
merged_peft_base = peft8.merge_and_unload()
"""