333 Commits

Author	SHA1	Message	Date
oobabooga	304f812c63	Gracefully handle CUDA out of memory errors with streaming	2023-03-28 19:20:50 -03:00
oobabooga	010b259dde	Update documentation	2023-03-28 17:46:00 -03:00
oobabooga	0bec15ebcd	Reorder imports	2023-03-28 17:34:15 -03:00
Maya Eary	41ec682834	Disable kernel threshold for gpt-j	2023-03-28 22:45:38 +03:00
Maya	1ac003d41c	Merge branch 'oobabooga:main' into feature/gpt-j-4bit-v2	2023-03-28 22:30:39 +03:00
Maya Eary	1c075d8d21	Fix typo	2023-03-28 20:43:50 +03:00
Maya Eary	c8207d474f	Generalized load_quantized	2023-03-28 20:38:55 +03:00
oobabooga	8579fe51dd	Fix new lines in the HTML tab	2023-03-28 12:59:34 -03:00
Alex "mcmonkey" Goodwin	e817fac542	better defaults	2023-03-27 22:29:23 -07:00
Alex "mcmonkey" Goodwin	2e08af4edf	implement initial Raw Text File Input ... also bump default Rank & Alpha for values that will make sense in testing if you don't know what you're doing and leave the defaults.	2023-03-27 22:15:32 -07:00
Alex "mcmonkey" Goodwin	b749952fe3	change number minimums to 0 ... gradio calculates 'step' relative to the minimum, so at '1' the step values were all offset awkwardly. 0 isn't valid, but, uh, just don't slam the slider to the left.	2023-03-27 21:22:43 -07:00
Alex "mcmonkey" Goodwin	ec6224f556	use new shared.args.lora_dir	2023-03-27 20:04:16 -07:00
Alex "mcmonkey" Goodwin	31f04dc615	Merge branch 'main' into add-train-lora-tab	2023-03-27 20:03:30 -07:00
oobabooga	53da672315	Fix FlexGen	2023-03-27 23:44:21 -03:00
oobabooga	ee95e55df6	Fix RWKV tokenizer	2023-03-27 23:42:29 -03:00
oobabooga	036163a751	Change description	2023-03-27 23:39:26 -03:00
oobabooga	005f552ea3	Some simplifications	2023-03-27 23:29:52 -03:00
oobabooga	fde92048af	Merge branch 'main' into catalpaaa-lora-and-model-dir	2023-03-27 23:16:44 -03:00
Alex "mcmonkey" Goodwin	8a97f6ba29	corrections per the PR comments	2023-03-27 18:39:06 -07:00
Alex "mcmonkey" Goodwin	7fab7ea1b6	couple missed camelCases	2023-03-27 18:19:06 -07:00
Alex "mcmonkey" Goodwin	6368dad7db	Fix camelCase to snake_case to match repo format standard	2023-03-27 18:17:42 -07:00
oobabooga	2f0571bfa4	Small style changes	2023-03-27 21:24:39 -03:00
oobabooga	c2cad30772	Merge branch 'main' into mcmonkey4eva-add-train-lora-tab	2023-03-27 21:05:44 -03:00
Alex "mcmonkey" Goodwin	9ced75746d	add total time estimate	2023-03-27 10:57:27 -07:00
Alex "mcmonkey" Goodwin	16ea4fc36d	interrupt button	2023-03-27 10:43:01 -07:00
Alex "mcmonkey" Goodwin	8fc723fc95	initial progress tracker in UI	2023-03-27 10:25:08 -07:00
oobabooga	48a6c9513e	Merge pull request #572 from clusterfudge/issues/571 ... Potential fix for issues/571	2023-03-27 14:06:38 -03:00
Alex "mcmonkey" Goodwin	c07bcd0850	add some outputs to indicate progress updates (sorta) ... Actual progressbar still needed. Also minor formatting fixes.	2023-03-27 09:41:06 -07:00
oobabooga	af65c12900	Change Stop button behavior	2023-03-27 13:23:59 -03:00
Alex "mcmonkey" Goodwin	d911c22af9	use shared rows to make the LoRA Trainer interface a bit more compact / clean	2023-03-27 08:31:49 -07:00
Alex "mcmonkey" Goodwin	e439228ed8	Merge branch 'main' into add-train-lora-tab	2023-03-27 08:21:19 -07:00
oobabooga	3dc61284d5	Handle unloading LoRA from dropdown menu icon	2023-03-27 00:04:43 -03:00
oobabooga	1c77fdca4c	Change notebook mode appearance	2023-03-26 22:20:30 -03:00
oobabooga	49c10c5570	Add support for the latest GPTQ models with group-size (#530) ... **Warning: old 4-bit weights will not work anymore!** See here how to get up to date weights: https://github.com/oobabooga/text-generation-webui/wiki/LLaMA-model#step-2-get-the-pre-converted-weights	2023-03-26 00:11:33 -03:00
Sean Fitzgerald	0bac80d9eb	Potential fix for issues/571	2023-03-25 13:08:45 -07:00
Alex "mcmonkey" Goodwin	f1ba2196b1	make 'model' variables less ambiguous	2023-03-25 12:57:36 -07:00
Alex "mcmonkey" Goodwin	8da237223e	document options better	2023-03-25 12:48:35 -07:00
Alex "mcmonkey" Goodwin	5c49a0dcd0	fix error from prepare call running twice in a row	2023-03-25 12:37:32 -07:00
Alex "mcmonkey" Goodwin	7bf601107c	automatically strip empty data entries (for better alpaca dataset compat)	2023-03-25 12:28:46 -07:00
Alex "mcmonkey" Goodwin	566898a79a	initial lora training tab	2023-03-25 12:08:26 -07:00
oobabooga	8c8e8b4450	Fix the early stopping callback #559	2023-03-25 12:35:52 -03:00
oobabooga	a1f12d607f	Merge pull request #538 from Ph0rk0z/display-input-context ... Add display of context when input was generated	2023-03-25 11:56:18 -03:00
catalpaaa	f740ee558c	Merge branch 'oobabooga:main' into lora-and-model-dir	2023-03-25 01:28:33 -07:00
oobabooga	25be9698c7	Fix LoRA on mps	2023-03-25 01:18:32 -03:00
oobabooga	3da633a497	Merge pull request #529 from EyeDeck/main ... Allow loading of .safetensors through GPTQ-for-LLaMa	2023-03-24 23:51:01 -03:00
catalpaaa	b37c54edcf	lora-dir, model-dir and login auth ... Added lora-dir, model-dir, and a login auth arguments that points to a file contains usernames and passwords in the format of "u:pw,u:pw,..."	2023-03-24 17:30:18 -07:00
oobabooga	9fa47c0eed	Revert GPTQ_loader.py (accident)	2023-03-24 19:57:12 -03:00
oobabooga	a6bf54739c	Revert models.py (accident)	2023-03-24 19:56:45 -03:00
oobabooga	0a16224451	Update GPTQ_loader.py	2023-03-24 19:54:36 -03:00
oobabooga	a80aa65986	Update models.py	2023-03-24 19:53:20 -03:00