9 Commits

Author	SHA1	Message	Date
oobabooga	056717923f	Document StreamingLLM	2024-03-10 19:15:23 -07:00
Bartowski	104573f7d4	Update cache_4bit documentation (#5649) ... --------- Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>	2024-03-07 13:08:21 -03:00
oobabooga	8a6d9abb41	Small fixes	2024-02-06 06:26:27 -08:00
oobabooga	cd4ffd3dd4	Update docs	2024-02-04 18:48:04 -08:00
oobabooga	0e54a09bcb	Remove exllamav1 loaders (#5128)	2023-12-31 01:57:06 -03:00
oobabooga	9d6f79db74	Revert "Bump llama-cpp-python to 0.2.18 (#4611)" ... This reverts commit 923c8e25fb.	2023-11-17 05:14:25 -08:00
oobabooga	8b66d83aa9	Set use_fast=True by default, create --no_use_fast flag ... This increases tokens/second for HF loaders.	2023-11-16 19:55:28 -08:00
oobabooga	923c8e25fb	Bump llama-cpp-python to 0.2.18 (#4611)	2023-11-16 22:55:14 -03:00
David Nielson	564d0cde82	Use standard hyphens in filenames (#4576)	2023-11-15 20:29:00 -03:00