File size: 474 Bytes
0f9456b
 
 
 
 
 
 
 
 
 
 
 
 
30053e1
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
---
title: SFT Phi2 QLoRA
emoji: 🦀
colorFrom: gray
colorTo: purple
sdk: gradio
sdk_version: 5.20.0
app_file: app.py
pinned: false
license: mit
short_description: Supervised Fine Tuned Phi model with QLoRA
---

In this project, open source Phi 2 model (base model) is trained on OpenAssistant dataset using QLoRA.
This has given the base model, ability to chat instead of randomly generating next token.

Project Repository: https://github.com/Shilpaj1994/SFT-with-QLoRA