AI/gpt4all
1
0
Fork 0
mirror of https://github.com/nomic-ai/gpt4all.git synced 2024-10-01 01:06:10 -04:00
Code Issues Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
Benjamin Schmidt 2023-03-30 13:46:03 -04:00 committed by GitHub
parent bc7eb80e02
commit b9861f7510
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
README.md
View File

@ -43,7 +43,7 @@ Note: the full model on GPU (16GB of RAM required) performs much better in our q
To get running using the python client with the CPU interface, first install the [nomic client](https://github.com/nomic-ai/nomic) using `pip install nomic`
Then, you can use the following script to interact with GPU4All:
```
from nomic import GPT4All
from nomic.gpt4all import GPT4All
m = GPT4All()
m.connect()
m.prompt('write me a story about a lonely computer')
@ -57,7 +57,7 @@ The setup here is slightly more involved than the CPU model.
Once this is done, you can run the model on GPU with a script like the following:
```
from nomic import GPT4AllGPU
from nomic.gpt4all import GPT4AllGPU
m = GPT4AllGPU(LLAMA_PATH)
config = {'num_beams': 2,
'min_new_tokens': 10,