Commit Graph

404 Commits

Author SHA1 Message Date
draff
28fd4fc970 Change wording to be consistent with other args 2023-03-10 23:34:13 +00:00
draff
804486214b Re-implement --load-in-4bit and update --llama-bits arg description 2023-03-10 23:21:01 +00:00
draff
e6c631aea4 Replace --load-in-4bit with --llama-bits
Replaces --load-in-4bit with a more flexible --llama-bits arg to allow for 2 and 3 bit models as well. This commit also fixes a loading issue with .pt files which are not in the root of the models folder
2023-03-10 21:36:45 +00:00
oobabooga
7c3d1b43c1
Merge pull request #204 from MichealC0/patch-1
Update README.md
2023-03-09 23:04:09 -03:00
oobabooga
1a3d25f75d
Merge pull request #206 from oobabooga/llama-4bit
Add LLaMA 4-bit support
2023-03-09 21:07:32 -03:00
oobabooga
eb0cb9b6df Update README 2023-03-09 20:53:52 -03:00
oobabooga
d41e3c233b
Update README.md 2023-03-09 18:02:44 -03:00
oobabooga
33414478bf Update README 2023-03-09 11:13:03 -03:00
oobabooga
e7adf5fe4e Add Contrastive Search preset #197 2023-03-09 10:27:11 -03:00
Chimdumebi Nebolisa
4dd14dcab4
Update README.md 2023-03-09 10:22:09 +01:00
oobabooga
b4bfd87319
Update README.md 2023-03-06 20:55:01 -03:00
oobabooga
d0e8780555
Update README.md 2023-03-06 20:17:59 -03:00
oobabooga
18ccfcd7fe
Update README.md 2023-03-06 20:15:55 -03:00
oobabooga
91823e1ed1
Update README.md 2023-03-06 16:48:31 -03:00
oobabooga
aa7ce0665e Merge branch 'main' of github.com:oobabooga/text-generation-webui 2023-03-06 10:58:41 -03:00
oobabooga
bf56b6c1fb Load settings.json without the need for --settings settings.json
This is for setting UI defaults
2023-03-06 10:57:45 -03:00
oobabooga
2de9f122cd
Update README.md 2023-03-06 09:34:49 -03:00
oobabooga
736f61610b Update README 2023-03-04 01:33:52 -03:00
oobabooga
76378c6cc2 Update README 2023-03-02 11:27:15 -03:00
oobabooga
f4b130e2bd
Update README.md 2023-02-27 15:15:45 -03:00
oobabooga
c183d2917c
Update README.md 2023-02-26 00:59:07 -03:00
oobabooga
cfe010b244
Update README.md 2023-02-26 00:54:37 -03:00
oobabooga
87d9f3e329
Update README.md 2023-02-26 00:54:19 -03:00
oobabooga
955997a90b
Update README.md 2023-02-26 00:54:07 -03:00
oobabooga
c593dfa827
Update README.md 2023-02-25 18:57:34 -03:00
oobabooga
7872a64f78
Update README.md 2023-02-25 18:56:43 -03:00
oobabooga
88cfc84ddb Update README 2023-02-25 01:33:26 -03:00
oobabooga
0b90e0b3b6
Update README.md 2023-02-24 12:01:07 -03:00
oobabooga
1a23e6d185
Add Pythia to README 2023-02-24 11:38:01 -03:00
oobabooga
f4f508c8e2
Update README.md 2023-02-24 09:03:09 -03:00
oobabooga
ced5d9ab04
Update README.md 2023-02-23 10:04:07 -03:00
oobabooga
b18071330f
Update README.md 2023-02-23 01:32:05 -03:00
oobabooga
b4a7f5fa70
Update README.md 2023-02-22 01:54:12 -03:00
oobabooga
e195377050 Deprecate torch dumps, move to safetensors (they load even faster) 2023-02-20 15:03:19 -03:00
oobabooga
58520a1f75
Update README.md 2023-02-20 12:44:31 -03:00
oobabooga
05e9da0c12
Update README.md 2023-02-18 22:34:51 -03:00
oobabooga
b1add0e586
Update README.md 2023-02-18 22:32:16 -03:00
oobabooga
348acdf626 Mention deepspeed in the README 2023-02-16 17:29:48 -03:00
oobabooga
05b53e4626 Update README 2023-02-15 14:43:34 -03:00
oobabooga
ed73d00bd5 Update README 2023-02-15 14:43:13 -03:00
oobabooga
30fcb26737 Update README 2023-02-15 14:42:41 -03:00
oobabooga
5ee9283cae Mention BLIP 2023-02-15 13:53:38 -03:00
oobabooga
8d3b3959e7 Document --picture option 2023-02-15 13:50:18 -03:00
oobabooga
01e5772302
Update README.md 2023-02-14 13:06:26 -03:00
oobabooga
210c918199
Update README.md 2023-02-13 21:49:19 -03:00
oobabooga
b7ddcab53a
Update README.md 2023-02-13 15:52:49 -03:00
oobabooga
939e9d00a2
Update README.md 2023-02-12 00:47:03 -03:00
oobabooga
bf9dd8f8ee Add --text-only option to the download script 2023-02-12 00:42:56 -03:00
oobabooga
42cc307409
Update README.md 2023-02-12 00:34:55 -03:00
oobabooga
144857acfe Update README 2023-02-11 14:49:11 -03:00
oobabooga
0dd1409f24 Add penalty_alpha parameter (contrastive search) 2023-02-11 14:48:12 -03:00
oobabooga
8aafb55693
1-click installer now also works for AMD GPUs
(I think)
2023-02-11 14:24:47 -03:00
oobabooga
1176d64b13
Update README.md 2023-02-11 07:56:12 -03:00
Spencer-Dawson
c5324d653b
re-added missed README changes 2023-02-11 00:13:06 -07:00
oobabooga
cf89ef1c74
Update README.md 2023-02-10 21:46:29 -03:00
oobabooga
8782ac1911
Update README.md 2023-02-10 17:10:27 -03:00
oobabooga
7d7cc37560
Add Linux 1-click installer 2023-02-10 17:09:53 -03:00
oobabooga
991de5ed40
Update README.md 2023-02-09 14:36:47 -03:00
oobabooga
04d3d0aee6
Add 1-click windows installer (for #45) 2023-02-09 13:27:30 -03:00
oobabooga
a21620fc59 Update README 2023-02-08 01:17:50 -03:00
oobabooga
fc0493d885 Add credits 2023-02-08 00:09:41 -03:00
oobabooga
53af062fa5
Update README.md 2023-02-05 23:14:25 -03:00
oobabooga
90bb2caffd
Update README.md 2023-02-03 19:45:11 -03:00
oobabooga
93b0d1b1b8
Update README.md 2023-02-03 10:14:52 -03:00
oobabooga
6212b41930 Update README 2023-02-03 09:13:14 -03:00
oobabooga
7f4315b120
Mention 8bit fix for Windows users
Closes #44, #20
2023-02-02 11:00:57 -03:00
oobabooga
7aa3d6583e
Update README.md 2023-01-30 09:45:31 -03:00
oobabooga
239f96a9c5
Add extensions guide 2023-01-30 09:44:57 -03:00
oobabooga
f92996b3c8
Update README.md 2023-01-29 14:37:05 -03:00
oobabooga
9e4db10cd0
Update README.md 2023-01-29 03:13:22 -03:00
oobabooga
1a139664f5 Grammar 2023-01-29 02:54:36 -03:00
oobabooga
89c862b179 Update README 2023-01-28 20:37:43 -03:00
oobabooga
6b5dcd46c5 Add support for extensions
This is experimental.
2023-01-27 00:40:39 -03:00
oobabooga
d49710878e
Update README.md 2023-01-26 16:17:15 -03:00
oobabooga
ff180f3e60
Update installation instructions (for #15) 2023-01-26 12:32:21 -03:00
oobabooga
61611197e0 Add --verbose option (oops) 2023-01-26 02:18:06 -03:00
oobabooga
64f278d248 Update README 2023-01-25 19:43:30 -03:00
oobabooga
b77933d327 File names must be img_me.jpg and img_bot.jpg 2023-01-25 19:40:30 -03:00
oobabooga
fc73188ec7 Allow specifying your own profile picture in chat mode 2023-01-25 19:37:44 -03:00
oobabooga
651eb50dd1 Merge branch 'main' of github.com:oobabooga/text-generation-webui 2023-01-25 10:20:03 -03:00
oobabooga
3b8f0021cc Stop generating at \nYou: in chat mode 2023-01-25 10:17:55 -03:00
oobabooga
befabbb862
Update README.md 2023-01-24 23:01:43 -03:00
oobabooga
7b98971df1
Update README.md 2023-01-24 18:39:29 -03:00
oobabooga
86b237eb0b
Update README.md 2023-01-24 09:29:34 -03:00
oobabooga
c2d1f04305
Update README.md 2023-01-23 23:34:20 -03:00
oobabooga
6c40f7eeb4 New NovelAI/KoboldAI preset selection 2023-01-23 20:44:27 -03:00
oobabooga
22845ba445 Update README 2023-01-23 13:41:50 -03:00
oobabooga
5b60691367 Update README 2023-01-23 10:05:25 -03:00
oobabooga
085d5cbcb9 Update README 2023-01-23 10:03:19 -03:00
oobabooga
8a68930220 Update README 2023-01-23 10:02:35 -03:00
oobabooga
3c5454c6f8 Update README 2023-01-22 19:38:07 -03:00
oobabooga
8f37383dc6 Update README 2023-01-22 19:29:24 -03:00
oobabooga
9592e7e618 Update README 2023-01-22 19:28:03 -03:00
oobabooga
c410fe5ab8 Add simplified colab notebook 2023-01-22 19:27:30 -03:00
oobabooga
41806fe40d
Update chat screenshot 2023-01-22 17:28:51 -03:00
oobabooga
00f3b0996b Warn the user that chat mode becomes a lot slower with text streaming 2023-01-22 16:19:11 -03:00
oobabooga
5b50db9dee Mention pygmalion support 2023-01-22 01:30:55 -03:00
oobabooga
6b06fca2f1 Mention pygmalion support 2023-01-22 01:28:52 -03:00
oobabooga
434d4b128c Add refresh buttons for the model/preset/character menus 2023-01-22 00:02:46 -03:00
oobabooga
bc664ecf3b Update the installation instructions for low attention span people 2023-01-21 22:54:35 -03:00
oobabooga
f9dbe7e08e Update README 2023-01-21 03:05:55 -03:00
oobabooga
990ee54ddd Move the example dialogue to the chat history, and keep it hidden.
This greatly improves the performance of text generation, as
histories can be quite long. It also makes more sense to implement
it this way.
2023-01-21 02:48:06 -03:00
oobabooga
d7299df01f Rename parameters 2023-01-21 00:33:41 -03:00
oobabooga
5df03bf0fd
Merge branch 'main' into main 2023-01-21 00:25:34 -03:00
oobabooga
faaafe7c0e Better parameter naming 2023-01-20 23:45:16 -03:00
Silver267
f4634e4c32 Update. 2023-01-20 17:05:43 -05:00
oobabooga
83584ae2d7 Clearer installation instructions 2023-01-20 00:20:35 -03:00
oobabooga
8d4170826f Update README 2023-01-19 21:08:26 -03:00
oobabooga
cd7b07239f Add Colab guide 2023-01-19 17:58:04 -03:00
oobabooga
83808171d3 Add --share option for Colab 2023-01-19 17:31:29 -03:00
oobabooga
b054367be2 Update README 2023-01-19 16:54:58 -03:00
oobabooga
f9faad4cfa Add low VRAM guide 2023-01-19 11:25:17 -03:00
oobabooga
7ace04864a Implement sending layers to disk with --disk (#10) 2023-01-19 11:09:24 -03:00
oobabooga
1ce95ee817 Mention text streaming 2023-01-19 10:46:41 -03:00
oobabooga
93fa9bbe01 Clean up the streaming implementation 2023-01-19 10:43:05 -03:00
oobabooga
6456777b09 Clean things up 2023-01-16 16:35:45 -03:00
oobabooga
99d24bdbfe
Update README.md 2023-01-16 11:23:45 -03:00
oobabooga
ed1d2c0d38
Update README.md 2023-01-16 11:19:23 -03:00
oobabooga
82c50a09b2
Update README.md 2023-01-16 10:31:13 -03:00
oobabooga
3a28865eb2
Update README.md 2023-01-16 10:07:00 -03:00
oobabooga
18626c4788
Update README.md 2023-01-16 01:51:59 -03:00
oobabooga
a3bb18002a Update README 2023-01-15 22:34:56 -03:00
oobabooga
ebf4d5f506 Add --max-gpu-memory parameter for #7 2023-01-15 22:33:35 -03:00
oobabooga
e6691bd920 Make chat mode more like cai 2023-01-15 18:16:46 -03:00
oobabooga
9f1b6e0398 Update README 2023-01-15 16:50:58 -03:00
oobabooga
99b35dd48d Update README 2023-01-15 15:46:09 -03:00
oobabooga
027c3dd27d Allow jpg profile images 2023-01-15 15:45:25 -03:00
oobabooga
ada2e556d0 Update README 2023-01-15 15:41:36 -03:00
oobabooga
26d8ec3188 Update README 2023-01-15 15:40:03 -03:00
oobabooga
afe9f77f96 Reorder parameters 2023-01-15 15:30:39 -03:00
oobabooga
88d67427e1 Implement default settings customization using a json file 2023-01-15 15:23:41 -03:00
oobabooga
56be7149aa Update README 2023-01-15 12:39:31 -03:00
oobabooga
6136da419c Add --cai-chat option that mimics Character.AI's interface 2023-01-15 12:20:04 -03:00
oobabooga
d0af274185 Update README 2023-01-15 04:29:19 -03:00
oobabooga
5bbba25528 Move screenshots somewhere else 2023-01-15 04:27:22 -03:00
oobabooga
0aefcded63 Update README 2023-01-15 04:12:04 -03:00
oobabooga
9a261d82e9 Update README 2023-01-15 03:35:57 -03:00
oobabooga
b73decda6f Update README 2023-01-15 03:34:34 -03:00
oobabooga
525834ea34 Update README 2023-01-15 03:33:32 -03:00
oobabooga
34021131ff
Credit the presets 2023-01-15 03:00:59 -03:00
oobabooga
fa29cd8698
Update README.md 2023-01-15 02:51:52 -03:00
oobabooga
194e2f8439
Update README.md 2023-01-15 02:50:10 -03:00
oobabooga
830ec7123a Add more screenshots 2023-01-14 23:25:05 -03:00
oobabooga
3750e301a1 Update README 2023-01-13 11:33:38 -03:00
oobabooga
7299159360 Mention pygmalion 2023-01-13 09:33:38 -03:00
oobabooga
acf3d6d27e I have tested the CPU conda requirements and this works 2023-01-13 09:19:39 -03:00
oobabooga
d3bd6a3093 Installation instructions 2023-01-13 01:39:09 -03:00
oobabooga
44b4274ec2 Installation instructions 2023-01-13 01:37:12 -03:00
oobabooga
323aaa074f Installation instructions 2023-01-13 01:29:36 -03:00
oobabooga
886c12dd77 Add more detailed installation instructions 2023-01-13 01:27:29 -03:00
oobabooga
aeff0d4cc1 Update README 2023-01-11 23:04:06 -03:00
oobabooga
e0ec20c1b7 Update readme 2023-01-11 23:01:50 -03:00
oobabooga
5ba60f83a4 Add detailed gpt4chan installation instructions 2023-01-11 23:00:31 -03:00
oobabooga
21415f6988 Mention API 2023-01-11 16:51:32 -03:00
oobabooga
d5e01c80e3 Add nice HTML output for all models 2023-01-11 01:10:11 -03:00
oobabooga
89fd0180b7 Better description of features 2023-01-10 23:30:41 -03:00
oobabooga
a236b24d24 Add --auto-devices and --load-in-8bit options for #4 2023-01-10 23:16:33 -03:00
oobabooga
3aefcfd963 Grammar 2023-01-09 19:07:47 -03:00
oobabooga
7028116bf2 Fix 2023-01-09 19:07:10 -03:00
oobabooga
222ae23fe0 Fix 2023-01-09 19:06:29 -03:00
oobabooga
6c178b1c91 Add --listen parameter 2023-01-09 19:05:36 -03:00
oobabooga
86092d1879 Update README 2023-01-09 18:58:24 -03:00
oobabooga
9aa51ca227 Update README 2023-01-09 18:18:35 -03:00
oobabooga
fbbad7cf8a Mention units 2023-01-09 18:14:09 -03:00
oobabooga
306be22b8e Add system requirements 2023-01-09 18:12:41 -03:00
oobabooga
96a75b616b Update README 2023-01-09 16:19:57 -03:00
oobabooga
f737029ee5 Update README 2023-01-09 16:15:54 -03:00
oobabooga
9704cfaa45 Update README 2023-01-09 16:09:27 -03:00
oobabooga
e2a917b3bf Update README 2023-01-09 11:11:05 -03:00
oobabooga
0e67ccf607 Implement CPU mode 2023-01-09 10:58:46 -03:00
oobabooga
b801e0d50d Minor changes 2023-01-08 14:37:43 -03:00
oobabooga
a0b1b1beb2 Mention gpt4chan's config.json 2023-01-07 23:13:43 -03:00
oobabooga
f76bdadbed Add chat mode 2023-01-07 22:52:46 -03:00
oobabooga
c82ccbb24d Update README 2023-01-07 19:23:59 -03:00
oobabooga
596b40f982 Update readme 2023-01-07 19:22:43 -03:00
oobabooga
0a967bf86d Link galactica 2023-01-07 19:19:55 -03:00
oobabooga
971fb8e011 Mention the features 2023-01-07 18:40:51 -03:00
oobabooga
b53b658320 Update the README 2023-01-06 20:29:00 -03:00
oobabooga
e5f547fc87 Implement notebook mode 2023-01-06 20:22:26 -03:00
oobabooga
6c02fe7a94 Update the README 2023-01-06 20:09:06 -03:00
oobabooga
eb3aa6b3d7 Update the README 2023-01-06 20:08:43 -03:00
oobabooga
6f2b804de2 Update the README 2023-01-06 20:07:58 -03:00
oobabooga
f3f802454c Update the README 2023-01-06 20:07:11 -03:00
oobabooga
8f789ed999 Update README 2023-01-06 20:06:24 -03:00
oobabooga
8c3746b629 Add updates to README 2023-01-06 20:00:58 -03:00
oobabooga
ee88d02292 Small fix 2023-01-06 02:13:48 -03:00
oobabooga
d47e518a02 Improve instructions 2023-01-06 02:12:38 -03:00
oobabooga
4142760d56 Better wording 2023-01-06 01:44:40 -03:00
oobabooga
285032da36 Make model loading more transparent 2023-01-06 01:41:52 -03:00
oobabooga
c65bad40dc Add support for presets 2023-01-06 01:33:21 -03:00
oobabooga
77214d155c Update 2023-01-06 00:18:34 -03:00
oobabooga
e76727267d Update 2023-01-06 00:14:33 -03:00
oobabooga
276ef0032d Mention more models 2023-01-06 00:13:26 -03:00
oobabooga
7daebf91bb Update 2023-01-06 00:07:51 -03:00
oobabooga
960d881148 Merge branch 'main' of github.com:oobabooga/text-generation-webui 2023-01-06 00:06:48 -03:00
oobabooga
39d47bb8a9 Update the installation instructions (fixes #1) 2023-01-06 00:05:11 -03:00
oobabooga
a90097e0b8
Update README.md 2022-12-21 21:49:03 -03:00
oobabooga
e0583f0ec2
Update README.md 2022-12-21 16:52:23 -03:00
oobabooga
261684f92e
Update README.md 2022-12-21 16:49:30 -03:00
oobabooga
65352bc189
Update README.md 2022-12-21 15:00:16 -03:00
oobabooga
e3d7c99987
Update README.md 2022-12-21 14:37:50 -03:00
oobabooga
5018b0fb65
Update README.md 2022-12-21 14:04:51 -03:00
oobabooga
dde76a962f Initial commit 2022-12-21 13:17:06 -03:00
oobabooga
ad71774a24
Initial commit 2022-12-21 01:17:38 -03:00