mirror of
https://github.com/nomic-ai/gpt4all.git
synced 2024-10-01 01:06:10 -04:00
27 lines
1.9 KiB
Markdown
27 lines
1.9 KiB
Markdown
|
# Troubleshooting
|
||
|
|
|
||
|
|
## Error Loading Models
|
||
|
|
|
||
|
|
It is possible you are trying to load a model from HuggingFace whose weights are not compatible with our [backend](https://github.com/nomic-ai/gpt4all/tree/main/gpt4all-bindings).
|
||
|
|
|
||
|
|
Try downloading one of the officially supported models mentioned our [website](https://gpt4all.io/). If the problem persists, please share your experience on our [Discord](https://discord.com/channels/1076964370942267462).
|
||
|
|
|
||
|
|
## Bad Responses
|
||
|
|
|
||
|
|
Try the [example chats](../gpt4all_desktop/chats.md) to double check that your system is implementing models correctly.
|
||
|
|
|
||
|
|
### Responses Incoherent
|
||
|
|
|
||
|
|
If you are seeing something **not at all** resembling the [example chats](../gpt4all_desktop/chats.md) - for example, if the responses you are seeing look nonsensical - try [downloading a different model](../gpt4all_desktop/models.md), and please share your experience on our [Discord](https://discord.com/channels/1076964370942267462).
|
||
|
|
|
||
|
|
### Responses Incorrect
|
||
|
|
|
||
|
|
LLMs can be unreliable. It's helpful to know what their training data was - they are less likely to be correct when asking about data they were not trained on unless you give the necessary information in the prompt as **context**.
|
||
|
|
|
||
|
|
Giving LLMs additional context, like chatting using [LocalDocs](../gpt4all_desktop/localdocs.md), can help merge the language model's ability to understand text with the files that you trust to contain the information you need.
|
||
|
|
|
||
|
|
Including information in a prompt is not a guarantee that it will be used correctly, but the more clear and concise your prompts, and the more relevant your prompts are to your files, the better.
|
||
|
|
|
||
|
|
### LocalDocs Issues
|
||
|
|
|
||
|
|
Occasionally a model - particularly a smaller or overall weaker LLM - may not use the relevant text snippets from the files that were referenced via LocalDocs. If you are seeing this, it can help to use phrases like "in the docs" or "from the provided files" when prompting your model.
|