Add back low_cpu_mem_usage=True

Removing it didn't help with anything, so I am adding it bad on a purely
superstiticious basis.
This commit is contained in:
oobabooga 2023-02-01 10:01:44 -03:00
parent d4a0b377ab
commit 119be56390

View File

@ -88,7 +88,7 @@ def load_model(model_name):
# Custom
else:
command = "AutoModelForCausalLM.from_pretrained"
settings = []
settings = ["low_cpu_mem_usage=True"]
if args.cpu:
settings.append("low_cpu_mem_usage=True")