AI/gpt4all
1
0
Fork 0
mirror of https://github.com/nomic-ai/gpt4all.git synced 2024-10-01 01:06:10 -04:00
Code Issues Packages Projects Releases Wiki Activity

Fixing API problem - bin files are deprecated

Browse Source
This commit is contained in:
dsalvat1 2023-11-07 14:31:48 -05:00 committed by AT
parent 9e27a118ed
commit f3eaa33ce7
3 changed files with 6 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

3
gpt4all-api/docker-compose.yaml
View File

@ -12,8 +12,9 @@ services:
- WEB_CONCURRENCY=2 - WEB_CONCURRENCY=2
- LOGLEVEL=debug - LOGLEVEL=debug
- PORT=4891 - PORT=4891
- model=ggml-mpt-7b-chat.bin - model=${MODEL_ID}
- inference_mode=cpu - inference_mode=cpu
volumes: volumes:
- './gpt4all_api/app:/app' - './gpt4all_api/app:/app'
- './gpt4all_api/models:/models'
command: ["/start-reload.sh"] command: ["/start-reload.sh"]

3
gpt4all-api/gpt4all_api/env Normal file
View File

@ -0,0 +1,3 @@
# Add your GGUF compatible model LLM here. ie: MODEL_BIN="mistral-7b-instruct-v0.1.Q4_0", rename file ".env"
# Make sure this LLM matches the model you placed inside the models folder
MODEL_BIN=""

1
gpt4all-api/gpt4all_api/models/README.md Normal file
View File

@ -0,0 +1 @@
# Drop GGUF compatible models here, make sure it matches MODEL_BIN on your .env file