|
--- |
|
license: apache-2.0 |
|
--- |
|
|
|
### Hello |
|
|
|
Thanks for your interest in the Brads-LLMs packages. These are free for your use. These packages are built with llamafile and run on macOS, Windows, and Linux. |
|
Smaller models will even run on a Rasberry Pi! |
|
You should be familiar with running scripts on your computer. If you're not, please get help from someone who is. |
|
|
|
If you would like paid assistance or need help with AI projects, please email me or start a discussion in the community. |
|
I do not accept pull requests. |
|
|
|
-Brad<br/> |
|
Brad Hutchings<br/> |
|
[email protected] |
|
|
|
<hr/> |
|
|
|
### Windows Instructions |
|
|
|
Video: https://youtu.be/HRqaBoNajCM |
|
|
|
1. If you have not used PowerShell on your computer previously, you must enable scripting. |
|
1. Run PowerShell as Administrator. |
|
2. Paste this command and press the **enter** key: |
|
``` |
|
Set-ExecutionPolicy Unrestricted |
|
``` |
|
This will allow you to run scripts with permission each time. When you feel comfortable running scripts and, most importantly, |
|
not running scripts you shouldn't run that might compromise your computer, run this command: |
|
``` |
|
Set-ExecutionPolicy Bypass |
|
``` |
|
3. Close the PowerShell window. |
|
1. Go to the **Files and versions** tab of this web page. |
|
2. Download the file **Brads-LLMs (Windows).zip**. |
|
3. Once downloaded, move the file to your Desktop and extract there. |
|
4. Open that new folder. right-click the **Start-Apple-OpenELM-1.1B-Instruct.ps1**. Choose **Run with PowerShell***. |
|
- The script will download a `.gguf` model for Apple OpenELM 1.1B Instruct that I have prepared to the `models` sub-folder. This may take a few minutes. |
|
- The script will launch my `Brads-LLMs-llamafile.exe` executable to run the model. |
|
- A web browser window will open. Follow instuctions there. |
|
5. When you're finished with the model, close the web browser tab and close the PowerShell or Command window. |
|
<hr/> |
|
### macOS, Linux, Raspberry Pi. etc. Instructions |
|
1. Go to the **Files and versions** tab of this web page. |
|
2. Download the file **Brads-LLMs (macOS-Linux).zip**. |
|
3. Once downloaded, move the file to your Desktop and extract there. |
|
4. Open a Terminal. Type commands: |
|
``` |
|
cd ~/Desktop/Brads-LLMs\ \(macOS-Linux\) |
|
chmod a+x * |
|
ls -al |
|
``` |
|
(Picture of files with x bits set goes here.) |
|
5. Open that new folder. right-click the **Start-Apple-OpenELM-1.1B-Instruct.sh**. There should be a menu item to "run" the script. Choose that. |
|
- The script will download a `.gguf` model for Apple OpenELM 1.1B Instruct that I have prepared to the `models` sub-folder. This may take a few minutes. |
|
- The script will launch my `Brads-LLMs-llamafile.exe` executable to run the model. |
|
- A web browser window will open. Follow instuctions there. |
|
6. When you're finished with the model, close the web browser tab and close the PowerShell or Command window. |
|
#### macOS Users |
|
- **Note:** When you right-click the `.sh` script file, choose **Open** from the context menu that appears. |
|
You may get a warning about the script. You can allow the script in the privacy settings:<br/> |
|
https://support.apple.com/guide/mac-help/open-a-mac-app-from-an-unknown-developer-mh40616/mac |
|
- **Note:** You may be asked to enable Developer Tools or some such when you launch the Terminal app for the first time. |
|
If this isn't a familiar place for you, please get some basic help from someone who knows their way around the Terminal. |
|
|
