2023-04-09 03:28:39 +00:00
|
|
|
# gpt4all-chat
|
2023-04-09 03:46:23 +00:00
|
|
|
|
|
|
|
|
Cross platform Qt based GUI for GPT4All versions with GPT-J as the base
|
|
|
|
|
model. NOTE: The model seen in the screenshot is actually the original
|
|
|
|
|
GPT-J model.
|
|
|
|
|
|
2023-04-09 03:41:49 +00:00
|
|
|
|
2023-04-09 03:46:23 +00:00
|
|
|
|
|
|
|
|
## Features
|
|
|
|
|
|
|
|
|
|
* Cross-platform (Linux, Windows, MacOSX, iOS, Android, Embedded Linux, QNX)
|
|
|
|
|
* Fast CPU based inference using ggml for GPT-J based models
|
|
|
|
|
* The UI is made to look and feel like you've come to expect from a chatty gpt
|
|
|
|
|
* Easy to install... The plan is to create precompiled binaries for major platforms with easy installer including model
|
|
|
|
|
|
2023-04-09 04:01:42 +00:00
|
|
|
## Building and running
|
2023-04-09 03:53:24 +00:00
|
|
|
|
|
|
|
|
* Install Qt 6.x for your platform https://doc.qt.io/qt-6/get-and-install-qt.html
|
|
|
|
|
* Install cmake for your platform https://cmake.org/install/
|
2023-04-09 04:01:42 +00:00
|
|
|
* Download https://huggingface.co/EleutherAI/gpt-j-6b
|
2023-04-09 03:54:25 +00:00
|
|
|
* Clone this repo and build
|
|
|
|
|
```
|
|
|
|
|
git clone --recurse-submodules https://github.com/manyoso/gpt4all-chat.git
|
|
|
|
|
cd gpt4all-chat
|
|
|
|
|
mkdir build
|
|
|
|
|
cd build
|
|
|
|
|
cmake ..
|
|
|
|
|
cmake --build . --parallel
|
2023-04-09 04:01:42 +00:00
|
|
|
python3 ../ggml/examples/gpt-j/convert-h5-to-ggml.py /path/to/your/local/copy/of/EleutherAI/gpt-j-6B 0
|
|
|
|
|
./bin/gpt-j-quantize /path/to/your/local/copy/of/EleutherAI/gpt-j-6B/ggml-model-f32.bin ./ggml-model-q4_0.bin 2
|
|
|
|
|
./chat
|
2023-04-09 03:54:25 +00:00
|
|
|
```
|
2023-04-09 03:53:24 +00:00
|
|
|
|
2023-04-09 03:46:23 +00:00
|
|
|
## Contributing
|
|
|
|
|
|
|
|
|
|
* Pull requests welcome :)
|
2023-04-09 03:53:24 +00:00
|
|
|
|
