AI/text-generation-webui
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2024-10-01 01:26:03 -04:00
Code Issues Packages Projects Releases Wiki Activity

ctransformers: Fix up model_type name consistency (#3567)

Browse Source
This commit is contained in:
cal066 2023-08-14 18:17:24 +00:00 committed by GitHub
parent ccfc02a28d
commit 991bb57e43
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
3 changed files with 5 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@ -259,7 +259,7 @@ Optionally, you can use the following command-line flags:
| Flag | Description |
|-------------|-------------|
| `--model_type MODEL_TYPE` | Model type of pre-quantized model. Currently gpt2, gptj, gpt_neox, falcon, llama, mpt, gpt_bigcode, dolly-v2, and replit are supported. |
| `--model_type MODEL_TYPE` | Model type of pre-quantized model. Currently gpt2, gptj, gptneox, falcon, llama, mpt, starcoder (gptbigcode), dollyv2, and replit are supported. |
#### AutoGPTQ

6
models/config.yaml
View File

@ -5,7 +5,7 @@
.*(gpt-j|gptj|gpt4all-j|malion-6b|pygway|pygmalion-6b|dolly-v1):
model_type: 'gptj'
.*(gpt-neox|koalpaca-polyglot|polyglot.*koalpaca|polyglot-ko|polyglot_ko|pythia|stablelm|incite|dolly-v2|polycoder|h2ogpt-oig|h2ogpt-oasst1|h2ogpt-gm):
model_type: 'gpt_neox'
model_type: 'gptneox'
.*llama:
model_type: 'llama'
.*bloom:
@ -17,9 +17,9 @@
.*mpt:
model_type: 'mpt'
.*(starcoder|starchat):
model_type: 'gpt_bigcode'
model_type: 'starcoder'
.*dolly-v2:
model_type: 'dolly-v2'
model_type: 'dollyv2'
.*replit:
model_type: 'replit'
llama-65b-gptq-3bit:

1
modules/loaders.py
View File

@ -290,6 +290,7 @@ loaders_model_types = {
"dollyv2"
"replit",
"starcoder",
"gptbigcode",
"falcon"
],
}