Commit Graph

5 Commits

Author SHA1 Message Date
oobabooga
613feca23b Make colab functional for llama.cpp
- Download only Q4_K_M for GGUF repositories by default
- Use maximum n-gpu-layers by default
2023-10-22 09:08:25 -07:00
oobabooga
994502d41b Colab fixes 2023-10-22 08:57:16 -07:00
oobabooga
05741821a5 Minor colab changes 2023-10-22 08:44:35 -07:00
mongolu
c18504f369
USE_CUDA118 from ENV remains null one_click.py + cuda-toolkit (#4352) 2023-10-22 12:37:24 -03:00
oobabooga
619093483e Add Colab notebook 2023-10-21 20:27:52 -07:00