Update default TopP to 0.4

TopP 0.1 was found to be somewhat too aggressive, so a more moderate default of 0.4 would be better suited for general use.

Signed-off-by: AMOGUS <137312610+Amogus8P@users.noreply.github.com>
This commit is contained in:
AMOGUS 2023-07-18 05:17:17 +03:00 committed by AT
parent 63849d9afc
commit 4974ae917c

View File

@ -108,7 +108,7 @@ private:
QString m_name; QString m_name;
QString m_filename; QString m_filename;
double m_temperature = 0.7; double m_temperature = 0.7;
double m_topP = 0.1; double m_topP = 0.4;
int m_topK = 40; int m_topK = 40;
int m_maxLength = 4096; int m_maxLength = 4096;
int m_promptBatchSize = 128; int m_promptBatchSize = 128;