2023-05-22 22:37:24 +00:00
# Generation parameters
For a description of the generation parameters provided by the transformers library, see this link: https://huggingface.co/docs/transformers/main_classes/text_generation#transformers.GenerationConfig
### llama.cpp
llama.cpp only uses the following parameters:
* temperature
* top_p
* top_k
* repetition_penalty
2023-06-17 22:08:25 +00:00
* tfs
2023-05-22 22:37:24 +00:00
* mirostat_mode
* mirostat_tau
* mirostat_eta
2023-06-17 22:08:25 +00:00
### ExLlama
ExLlama only uses the following parameters:
* temperature
* top_p
* top_k
* repetition_penalty
2023-07-04 05:39:01 +00:00
* repetition_penalty_range
2023-06-17 22:08:25 +00:00
* typical_p
2023-05-22 22:37:24 +00:00
### RWKV
2023-05-23 05:11:28 +00:00
RWKV only uses the following parameters when loaded through the old .pth weights:
2023-05-22 22:37:24 +00:00
* temperature
* top_p
* top_k
