From b4a7f5fa706d10786070ec11928ecf9480191a3e Mon Sep 17 00:00:00 2001 From: oobabooga <112222186+oobabooga@users.noreply.github.com> Date: Wed, 22 Feb 2023 01:54:12 -0300 Subject: [PATCH] Update README.md --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 0c210863..71ebc3d9 100644 --- a/README.md +++ b/README.md @@ -24,6 +24,7 @@ Its goal is to become the [AUTOMATIC1111/stable-diffusion-webui](https://github. * Load large models in 8-bit mode ([see here](https://github.com/oobabooga/text-generation-webui/issues/20#issuecomment-1411650652) if you are on Windows). * Split large models across your GPU(s), CPU, and disk. * CPU mode. +* [FlexGen offload](https://github.com/oobabooga/text-generation-webui/wiki/FlexGen). * [DeepSpeed ZeRO-3 offload](https://github.com/oobabooga/text-generation-webui/wiki/DeepSpeed). * [Get responses via API](https://github.com/oobabooga/text-generation-webui/blob/main/api-example.py). * Supports softprompts.