AI/alpaca-lora
1
0
Fork 0
mirror of https://github.com/tloen/alpaca-lora.git synced 2024-10-01 01:05:56 -04:00
Code Issues Packages Projects Releases Wiki Activity

Expand sampling in generate.py for new test

Browse Source
This commit is contained in:
Eric Wang 2023-03-16 09:58:59 -07:00
parent 9c1933721d
commit c3d94707ec
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
generate.py
View File

@ -53,7 +53,7 @@ def evaluate(instruction, input=None, **kwargs):
generation_config=generation_config,
return_dict_in_generate=True,
output_scores=True,
max_new_tokens=256,
max_new_tokens=2048,
)
s = generation_output.sequences[0]
output = tokenizer.decode(s)