Update README.md

This commit is contained in:
oobabooga 2023-05-11 10:21:20 -03:00 committed by GitHub
parent 400f3648f4
commit 23d3f6909a
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

View File

@ -99,7 +99,7 @@ pip install -r requirements.txt
#### 4. Install GPTQ-for-LLaMa and the monkey patch
The base installation covers regular transformers models as well as llama.cpp (GGML) models.
The base installation covers [transformers](https://github.com/huggingface/transformers) models (`AutoModelForCausalLM` and `AutoModelForSeq2SeqLM` specifically) and [llama.cpp](https://github.com/ggerganov/llama.cpp) (GGML) models.
To use 4-bit GPU models, the additional installation steps below are necessary: