7 Commits

Author	SHA1	Message	Date
oobabooga	c52290de50	ExLlama with long context (#2875)	2023-06-25 22:49:26 -03:00
oobabooga	3ae9af01aa	Add --no_use_cuda_fp16 param for AutoGPTQ	2023-06-23 12:22:56 -03:00
LarryVRH	580c1ee748	Implement a demo HF wrapper for exllama to utilize existing HF transformers decoding. (#2777)	2023-06-21 15:31:42 -03:00
oobabooga	5f392122fd	Add gpu_split param to ExLlama ... Adapted from code created by Ph0rk0z. Thank you Ph0rk0z.	2023-06-16 20:49:36 -03:00
oobabooga	9f40032d32	Add ExLlama support (#2444)	2023-06-16 20:35:38 -03:00
oobabooga	dea43685b0	Add some clarifications	2023-06-16 19:10:53 -03:00
oobabooga	7ef6a50e84	Reorganize model loading UI completely (#2720)	2023-06-16 19:00:37 -03:00