ipynb/llm/README.md

LLM Transfer Learning / Fine tuning

• Location of model development logs > https://drive.google.com/drive/folders/1OqUzYN_nfBSeZfbQ9qcB1YVkSNzi_gE3?usp=drive_link

Dataset and Model Migration

Overview

This README also serves as a guide and legend for the migration and update of datasets and models previously hosted under the ssoh namespace, now transferred to the BitBasher namespace on Hugging Face.

The purpose of this guide is to facilitate easy referencing with respect to the submitted codes.

Migration Details

Below is a detailed list of the datasets and models that have been moved, including their old and new locations:

• The term 'base model' refers to 'meta-llama/Llama-2-7b-chat-hf' on Hugging Face.

1. MCQ Dataset

   • Old Location: ssoh/mcq_dataset_2
   • New Location: BitBasher/mcq_dataset_2

2. Summarization and QnA Dataset

   • Old Location: ssoh/sum_n_qna_dataset
   • New Location: BitBasher/sum_n_qna_dataset

3. Model fine-tuned from a base model using the MCQ dataset

   • Old Location: ssoh/llama-2-7b-mcq_2
   • New Location: BitBasher/llama-2-7b-mcq_2

4. Model fine-tuned from the MCQ-tuned base model using the Summarization and QnA Dataset (also known as the Integrated model)

   • Old Location: ssoh/llama-2-7b-combined_datasets
   • New Location: BitBasher/llama-2-7b-combined_datasets

5. Integrated model converted to the GGUF format

   • Old Location: ssoh/llama-2-7b-combined_datasets-GGUF
   • New Location: BitBasher/llama-2-7b-combined_datasets-GGUF

6. Chosen model converted to the GGUF format

   • Old Location: ssoh/llama-2-7b-mini-ibased-GGUF
   • New Location: BitBasher/llama-2-7b-mini-ibased-GGUF

7. Chosen model

   • Old Location: ssoh/llama-2-7b-mini-ibased
   • New Location: BitBasher/llama-2-7b-mini-ibased

8. Initial dataset

   • Old Location: ssoh/mini-ibased-dataset
   • New Location: BitBasher/mini-ibased-dataset

Accessing the Datasets and Models

• To ensure uninterrupted access, please visit the new locations listed above to access the migrated datasets and models.