2023-05-10 13:38:32 -04:00
|
|
|
# Python GPT4All
|
|
|
|
|
2023-05-11 11:02:44 -04:00
|
|
|
This package contains a set of Python bindings around the `llmodel` C-API.
|
2023-05-10 13:38:32 -04:00
|
|
|
|
2023-05-12 10:30:03 -04:00
|
|
|
## Documentation
|
|
|
|
docs.gpt4all.io
|
|
|
|
|
2023-05-11 14:29:17 -04:00
|
|
|
## Installation
|
|
|
|
|
|
|
|
```
|
|
|
|
pip install gpt4all
|
|
|
|
```
|
2023-05-10 13:38:32 -04:00
|
|
|
|
2023-05-11 11:02:44 -04:00
|
|
|
## Local Build Instructions
|
2023-05-10 13:38:32 -04:00
|
|
|
|
|
|
|
1. Setup `llmodel`
|
|
|
|
|
|
|
|
```
|
2023-05-10 13:48:36 -04:00
|
|
|
git clone --recurse-submodules https://github.com/nomic-ai/gpt4all
|
2023-05-13 14:43:46 -04:00
|
|
|
cd gpt4all/gpt4all-backend/
|
2023-05-10 13:38:32 -04:00
|
|
|
mkdir build
|
|
|
|
cd build
|
|
|
|
cmake ..
|
|
|
|
cmake --build . --parallel
|
|
|
|
```
|
2023-05-14 07:41:45 -04:00
|
|
|
Confirm that `libllmodel.*` exists in `gpt4all-backend/build`.
|
2023-05-10 13:38:32 -04:00
|
|
|
|
|
|
|
2. Setup Python package
|
|
|
|
|
|
|
|
```
|
2023-05-10 13:48:36 -04:00
|
|
|
cd ../../gpt4all-bindings/python
|
2023-05-10 13:38:32 -04:00
|
|
|
pip3 install -e .
|
|
|
|
```
|
|
|
|
|
|
|
|
3. Test it out! In a Python script or console:
|
|
|
|
|
|
|
|
```python
|
|
|
|
|
|
|
|
from gpt4all import GPT4All
|
|
|
|
|
|
|
|
gptj = GPT4All("ggml-gpt4all-j-v1.3-groovy")
|
|
|
|
messages = [{"role": "user", "content": "Name 3 colors"}]
|
|
|
|
gptj.chat_completion(messages)
|
|
|
|
|
|
|
|
```
|