From f9faad4cfa980a452e9047176337ab29ef7d003e Mon Sep 17 00:00:00 2001 From: oobabooga <112222186+oobabooga@users.noreply.github.com> Date: Thu, 19 Jan 2023 11:25:17 -0300 Subject: [PATCH] Add low VRAM guide --- README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/README.md b/README.md index e0492532..4872ccdf 100644 --- a/README.md +++ b/README.md @@ -138,6 +138,8 @@ Optionally, you can use the following command-line flags: | `--no-stream` | Don't stream the text output in real time. This slightly improves the text generation performance.| | `--settings SETTINGS_FILE` | Load the default interface settings from this json file. See `settings-template.json` for an example.| +Out of memory errors? [Check this guide](https://github.com/oobabooga/text-generation-webui/wiki/Low-VRAM-guide). + ## Presets Inference settings presets can be created under `presets/` as text files. These files are detected automatically at startup.