AI/gpt4all
1
0
Fork 0
mirror of https://github.com/nomic-ai/gpt4all.git synced 2024-10-01 01:06:10 -04:00
Code Issues Packages Projects Releases Wiki Activity
d59ae64fa7
gpt4all/gpt4all-bindings/python
History
Richard Guo d59ae64fa7 fixed paths for c lib
2023-05-10 14:07:56 -04:00
..
docs transfer python bindings code 2023-05-10 13:38:32 -04:00
gpt4all refactor circle ci config 2023-05-10 13:57:54 -04:00
tests transfer python bindings code 2023-05-10 13:38:32 -04:00
.gitignore transfer python bindings code 2023-05-10 13:38:32 -04:00
LICENSE.txt transfer python bindings code 2023-05-10 13:38:32 -04:00
makefile transfer python bindings code 2023-05-10 13:38:32 -04:00
MANIFEST.in transfer python bindings code 2023-05-10 13:38:32 -04:00
mkdocs.yml transfer python bindings code 2023-05-10 13:38:32 -04:00
README.md refactor circle ci config 2023-05-10 13:57:54 -04:00
setup.py fixed paths for c lib 2023-05-10 14:07:56 -04:00

README.md

Python GPT4All

This package contains a set of Python bindings that runs the llmodel C-API.

Local Installation Instructions

TODO: Right now instructions in main README still depend on Qt6 setup. To setup Python bindings, we just need llmodel to be built which is much simpler. However, in the future, the below installation instructions should be sequentially organized such that we expect the main README's instructions were followed first.

  1. Setup llmodel
git clone --recurse-submodules https://github.com/nomic-ai/gpt4all
cd gpt4all-backend/llmodel/
mkdir build
cd build
cmake ..
cmake --build . --parallel

Confirm that libllmodel.* exists in gpt4all-backend/llmodel/build.

  1. Setup Python package
cd ../../gpt4all-bindings/python
pip3 install -r requirements.txt
pip3 install -e .
  1. Test it out! In a Python script or console:

from gpt4all import GPT4All

gptj = GPT4All("ggml-gpt4all-j-v1.3-groovy")
messages = [{"role": "user", "content": "Name 3 colors"}]
gptj.chat_completion(messages)