draff
28fd4fc970
Change wording to be consistent with other args
2023-03-10 23:34:13 +00:00
draff
804486214b
Re-implement --load-in-4bit and update --llama-bits arg description
2023-03-10 23:21:01 +00:00
draff
e6c631aea4
Replace --load-in-4bit with --llama-bits
...
Replaces --load-in-4bit with a more flexible --llama-bits arg to allow for 2 and 3 bit models as well. This commit also fixes a loading issue with .pt files which are not in the root of the models folder
2023-03-10 21:36:45 +00:00
oobabooga
7c3d1b43c1
Merge pull request #204 from MichealC0/patch-1
...
Update README.md
2023-03-09 23:04:09 -03:00
oobabooga
1a3d25f75d
Merge pull request #206 from oobabooga/llama-4bit
...
Add LLaMA 4-bit support
2023-03-09 21:07:32 -03:00
oobabooga
eb0cb9b6df
Update README
2023-03-09 20:53:52 -03:00
oobabooga
d41e3c233b
Update README.md
2023-03-09 18:02:44 -03:00
oobabooga
33414478bf
Update README
2023-03-09 11:13:03 -03:00
oobabooga
e7adf5fe4e
Add Contrastive Search preset #197
2023-03-09 10:27:11 -03:00
Chimdumebi Nebolisa
4dd14dcab4
Update README.md
2023-03-09 10:22:09 +01:00
oobabooga
b4bfd87319
Update README.md
2023-03-06 20:55:01 -03:00
oobabooga
d0e8780555
Update README.md
2023-03-06 20:17:59 -03:00
oobabooga
18ccfcd7fe
Update README.md
2023-03-06 20:15:55 -03:00
oobabooga
91823e1ed1
Update README.md
2023-03-06 16:48:31 -03:00
oobabooga
aa7ce0665e
Merge branch 'main' of github.com:oobabooga/text-generation-webui
2023-03-06 10:58:41 -03:00
oobabooga
bf56b6c1fb
Load settings.json without the need for --settings settings.json
...
This is for setting UI defaults
2023-03-06 10:57:45 -03:00
oobabooga
2de9f122cd
Update README.md
2023-03-06 09:34:49 -03:00
oobabooga
736f61610b
Update README
2023-03-04 01:33:52 -03:00
oobabooga
76378c6cc2
Update README
2023-03-02 11:27:15 -03:00
oobabooga
f4b130e2bd
Update README.md
2023-02-27 15:15:45 -03:00
oobabooga
c183d2917c
Update README.md
2023-02-26 00:59:07 -03:00
oobabooga
cfe010b244
Update README.md
2023-02-26 00:54:37 -03:00
oobabooga
87d9f3e329
Update README.md
2023-02-26 00:54:19 -03:00
oobabooga
955997a90b
Update README.md
2023-02-26 00:54:07 -03:00
oobabooga
c593dfa827
Update README.md
2023-02-25 18:57:34 -03:00
oobabooga
7872a64f78
Update README.md
2023-02-25 18:56:43 -03:00
oobabooga
88cfc84ddb
Update README
2023-02-25 01:33:26 -03:00
oobabooga
0b90e0b3b6
Update README.md
2023-02-24 12:01:07 -03:00
oobabooga
1a23e6d185
Add Pythia to README
2023-02-24 11:38:01 -03:00
oobabooga
f4f508c8e2
Update README.md
2023-02-24 09:03:09 -03:00
oobabooga
ced5d9ab04
Update README.md
2023-02-23 10:04:07 -03:00
oobabooga
b18071330f
Update README.md
2023-02-23 01:32:05 -03:00
oobabooga
b4a7f5fa70
Update README.md
2023-02-22 01:54:12 -03:00
oobabooga
e195377050
Deprecate torch dumps, move to safetensors (they load even faster)
2023-02-20 15:03:19 -03:00
oobabooga
58520a1f75
Update README.md
2023-02-20 12:44:31 -03:00
oobabooga
05e9da0c12
Update README.md
2023-02-18 22:34:51 -03:00
oobabooga
b1add0e586
Update README.md
2023-02-18 22:32:16 -03:00
oobabooga
348acdf626
Mention deepspeed in the README
2023-02-16 17:29:48 -03:00
oobabooga
05b53e4626
Update README
2023-02-15 14:43:34 -03:00
oobabooga
ed73d00bd5
Update README
2023-02-15 14:43:13 -03:00
oobabooga
30fcb26737
Update README
2023-02-15 14:42:41 -03:00
oobabooga
5ee9283cae
Mention BLIP
2023-02-15 13:53:38 -03:00
oobabooga
8d3b3959e7
Document --picture option
2023-02-15 13:50:18 -03:00
oobabooga
01e5772302
Update README.md
2023-02-14 13:06:26 -03:00
oobabooga
210c918199
Update README.md
2023-02-13 21:49:19 -03:00
oobabooga
b7ddcab53a
Update README.md
2023-02-13 15:52:49 -03:00
oobabooga
939e9d00a2
Update README.md
2023-02-12 00:47:03 -03:00
oobabooga
bf9dd8f8ee
Add --text-only option to the download script
2023-02-12 00:42:56 -03:00
oobabooga
42cc307409
Update README.md
2023-02-12 00:34:55 -03:00
oobabooga
144857acfe
Update README
2023-02-11 14:49:11 -03:00
oobabooga
0dd1409f24
Add penalty_alpha parameter (contrastive search)
2023-02-11 14:48:12 -03:00
oobabooga
8aafb55693
1-click installer now also works for AMD GPUs
...
(I think)
2023-02-11 14:24:47 -03:00
oobabooga
1176d64b13
Update README.md
2023-02-11 07:56:12 -03:00
Spencer-Dawson
c5324d653b
re-added missed README changes
2023-02-11 00:13:06 -07:00
oobabooga
cf89ef1c74
Update README.md
2023-02-10 21:46:29 -03:00
oobabooga
8782ac1911
Update README.md
2023-02-10 17:10:27 -03:00
oobabooga
7d7cc37560
Add Linux 1-click installer
2023-02-10 17:09:53 -03:00
oobabooga
991de5ed40
Update README.md
2023-02-09 14:36:47 -03:00
oobabooga
04d3d0aee6
Add 1-click windows installer (for #45 )
2023-02-09 13:27:30 -03:00
oobabooga
a21620fc59
Update README
2023-02-08 01:17:50 -03:00
oobabooga
fc0493d885
Add credits
2023-02-08 00:09:41 -03:00
oobabooga
53af062fa5
Update README.md
2023-02-05 23:14:25 -03:00
oobabooga
90bb2caffd
Update README.md
2023-02-03 19:45:11 -03:00
oobabooga
93b0d1b1b8
Update README.md
2023-02-03 10:14:52 -03:00
oobabooga
6212b41930
Update README
2023-02-03 09:13:14 -03:00
oobabooga
7f4315b120
Mention 8bit fix for Windows users
...
Closes #44 , #20
2023-02-02 11:00:57 -03:00
oobabooga
7aa3d6583e
Update README.md
2023-01-30 09:45:31 -03:00
oobabooga
239f96a9c5
Add extensions guide
2023-01-30 09:44:57 -03:00
oobabooga
f92996b3c8
Update README.md
2023-01-29 14:37:05 -03:00
oobabooga
9e4db10cd0
Update README.md
2023-01-29 03:13:22 -03:00
oobabooga
1a139664f5
Grammar
2023-01-29 02:54:36 -03:00
oobabooga
89c862b179
Update README
2023-01-28 20:37:43 -03:00
oobabooga
6b5dcd46c5
Add support for extensions
...
This is experimental.
2023-01-27 00:40:39 -03:00
oobabooga
d49710878e
Update README.md
2023-01-26 16:17:15 -03:00
oobabooga
ff180f3e60
Update installation instructions (for #15 )
2023-01-26 12:32:21 -03:00
oobabooga
61611197e0
Add --verbose option (oops)
2023-01-26 02:18:06 -03:00
oobabooga
64f278d248
Update README
2023-01-25 19:43:30 -03:00
oobabooga
b77933d327
File names must be img_me.jpg and img_bot.jpg
2023-01-25 19:40:30 -03:00
oobabooga
fc73188ec7
Allow specifying your own profile picture in chat mode
2023-01-25 19:37:44 -03:00
oobabooga
651eb50dd1
Merge branch 'main' of github.com:oobabooga/text-generation-webui
2023-01-25 10:20:03 -03:00
oobabooga
3b8f0021cc
Stop generating at \nYou: in chat mode
2023-01-25 10:17:55 -03:00
oobabooga
befabbb862
Update README.md
2023-01-24 23:01:43 -03:00
oobabooga
7b98971df1
Update README.md
2023-01-24 18:39:29 -03:00
oobabooga
86b237eb0b
Update README.md
2023-01-24 09:29:34 -03:00
oobabooga
c2d1f04305
Update README.md
2023-01-23 23:34:20 -03:00
oobabooga
6c40f7eeb4
New NovelAI/KoboldAI preset selection
2023-01-23 20:44:27 -03:00
oobabooga
22845ba445
Update README
2023-01-23 13:41:50 -03:00
oobabooga
5b60691367
Update README
2023-01-23 10:05:25 -03:00
oobabooga
085d5cbcb9
Update README
2023-01-23 10:03:19 -03:00
oobabooga
8a68930220
Update README
2023-01-23 10:02:35 -03:00
oobabooga
3c5454c6f8
Update README
2023-01-22 19:38:07 -03:00
oobabooga
8f37383dc6
Update README
2023-01-22 19:29:24 -03:00
oobabooga
9592e7e618
Update README
2023-01-22 19:28:03 -03:00
oobabooga
c410fe5ab8
Add simplified colab notebook
2023-01-22 19:27:30 -03:00
oobabooga
41806fe40d
Update chat screenshot
2023-01-22 17:28:51 -03:00
oobabooga
00f3b0996b
Warn the user that chat mode becomes a lot slower with text streaming
2023-01-22 16:19:11 -03:00
oobabooga
5b50db9dee
Mention pygmalion support
2023-01-22 01:30:55 -03:00
oobabooga
6b06fca2f1
Mention pygmalion support
2023-01-22 01:28:52 -03:00
oobabooga
434d4b128c
Add refresh buttons for the model/preset/character menus
2023-01-22 00:02:46 -03:00
oobabooga
bc664ecf3b
Update the installation instructions for low attention span people
2023-01-21 22:54:35 -03:00
oobabooga
f9dbe7e08e
Update README
2023-01-21 03:05:55 -03:00
oobabooga
990ee54ddd
Move the example dialogue to the chat history, and keep it hidden.
...
This greatly improves the performance of text generation, as
histories can be quite long. It also makes more sense to implement
it this way.
2023-01-21 02:48:06 -03:00
oobabooga
d7299df01f
Rename parameters
2023-01-21 00:33:41 -03:00
oobabooga
5df03bf0fd
Merge branch 'main' into main
2023-01-21 00:25:34 -03:00
oobabooga
faaafe7c0e
Better parameter naming
2023-01-20 23:45:16 -03:00
Silver267
f4634e4c32
Update.
2023-01-20 17:05:43 -05:00
oobabooga
83584ae2d7
Clearer installation instructions
2023-01-20 00:20:35 -03:00
oobabooga
8d4170826f
Update README
2023-01-19 21:08:26 -03:00
oobabooga
cd7b07239f
Add Colab guide
2023-01-19 17:58:04 -03:00
oobabooga
83808171d3
Add --share option for Colab
2023-01-19 17:31:29 -03:00
oobabooga
b054367be2
Update README
2023-01-19 16:54:58 -03:00
oobabooga
f9faad4cfa
Add low VRAM guide
2023-01-19 11:25:17 -03:00
oobabooga
7ace04864a
Implement sending layers to disk with --disk ( #10 )
2023-01-19 11:09:24 -03:00
oobabooga
1ce95ee817
Mention text streaming
2023-01-19 10:46:41 -03:00
oobabooga
93fa9bbe01
Clean up the streaming implementation
2023-01-19 10:43:05 -03:00
oobabooga
6456777b09
Clean things up
2023-01-16 16:35:45 -03:00
oobabooga
99d24bdbfe
Update README.md
2023-01-16 11:23:45 -03:00
oobabooga
ed1d2c0d38
Update README.md
2023-01-16 11:19:23 -03:00
oobabooga
82c50a09b2
Update README.md
2023-01-16 10:31:13 -03:00
oobabooga
3a28865eb2
Update README.md
2023-01-16 10:07:00 -03:00
oobabooga
18626c4788
Update README.md
2023-01-16 01:51:59 -03:00
oobabooga
a3bb18002a
Update README
2023-01-15 22:34:56 -03:00
oobabooga
ebf4d5f506
Add --max-gpu-memory parameter for #7
2023-01-15 22:33:35 -03:00
oobabooga
e6691bd920
Make chat mode more like cai
2023-01-15 18:16:46 -03:00
oobabooga
9f1b6e0398
Update README
2023-01-15 16:50:58 -03:00
oobabooga
99b35dd48d
Update README
2023-01-15 15:46:09 -03:00
oobabooga
027c3dd27d
Allow jpg profile images
2023-01-15 15:45:25 -03:00
oobabooga
ada2e556d0
Update README
2023-01-15 15:41:36 -03:00
oobabooga
26d8ec3188
Update README
2023-01-15 15:40:03 -03:00
oobabooga
afe9f77f96
Reorder parameters
2023-01-15 15:30:39 -03:00
oobabooga
88d67427e1
Implement default settings customization using a json file
2023-01-15 15:23:41 -03:00
oobabooga
56be7149aa
Update README
2023-01-15 12:39:31 -03:00
oobabooga
6136da419c
Add --cai-chat option that mimics Character.AI's interface
2023-01-15 12:20:04 -03:00
oobabooga
d0af274185
Update README
2023-01-15 04:29:19 -03:00
oobabooga
5bbba25528
Move screenshots somewhere else
2023-01-15 04:27:22 -03:00
oobabooga
0aefcded63
Update README
2023-01-15 04:12:04 -03:00
oobabooga
9a261d82e9
Update README
2023-01-15 03:35:57 -03:00
oobabooga
b73decda6f
Update README
2023-01-15 03:34:34 -03:00
oobabooga
525834ea34
Update README
2023-01-15 03:33:32 -03:00
oobabooga
34021131ff
Credit the presets
2023-01-15 03:00:59 -03:00
oobabooga
fa29cd8698
Update README.md
2023-01-15 02:51:52 -03:00
oobabooga
194e2f8439
Update README.md
2023-01-15 02:50:10 -03:00
oobabooga
830ec7123a
Add more screenshots
2023-01-14 23:25:05 -03:00
oobabooga
3750e301a1
Update README
2023-01-13 11:33:38 -03:00
oobabooga
7299159360
Mention pygmalion
2023-01-13 09:33:38 -03:00
oobabooga
acf3d6d27e
I have tested the CPU conda requirements and this works
2023-01-13 09:19:39 -03:00
oobabooga
d3bd6a3093
Installation instructions
2023-01-13 01:39:09 -03:00
oobabooga
44b4274ec2
Installation instructions
2023-01-13 01:37:12 -03:00
oobabooga
323aaa074f
Installation instructions
2023-01-13 01:29:36 -03:00
oobabooga
886c12dd77
Add more detailed installation instructions
2023-01-13 01:27:29 -03:00
oobabooga
aeff0d4cc1
Update README
2023-01-11 23:04:06 -03:00
oobabooga
e0ec20c1b7
Update readme
2023-01-11 23:01:50 -03:00
oobabooga
5ba60f83a4
Add detailed gpt4chan installation instructions
2023-01-11 23:00:31 -03:00
oobabooga
21415f6988
Mention API
2023-01-11 16:51:32 -03:00
oobabooga
d5e01c80e3
Add nice HTML output for all models
2023-01-11 01:10:11 -03:00
oobabooga
89fd0180b7
Better description of features
2023-01-10 23:30:41 -03:00
oobabooga
a236b24d24
Add --auto-devices and --load-in-8bit options for #4
2023-01-10 23:16:33 -03:00
oobabooga
3aefcfd963
Grammar
2023-01-09 19:07:47 -03:00
oobabooga
7028116bf2
Fix
2023-01-09 19:07:10 -03:00
oobabooga
222ae23fe0
Fix
2023-01-09 19:06:29 -03:00
oobabooga
6c178b1c91
Add --listen parameter
2023-01-09 19:05:36 -03:00
oobabooga
86092d1879
Update README
2023-01-09 18:58:24 -03:00
oobabooga
9aa51ca227
Update README
2023-01-09 18:18:35 -03:00
oobabooga
fbbad7cf8a
Mention units
2023-01-09 18:14:09 -03:00
oobabooga
306be22b8e
Add system requirements
2023-01-09 18:12:41 -03:00
oobabooga
96a75b616b
Update README
2023-01-09 16:19:57 -03:00
oobabooga
f737029ee5
Update README
2023-01-09 16:15:54 -03:00
oobabooga
9704cfaa45
Update README
2023-01-09 16:09:27 -03:00
oobabooga
e2a917b3bf
Update README
2023-01-09 11:11:05 -03:00
oobabooga
0e67ccf607
Implement CPU mode
2023-01-09 10:58:46 -03:00
oobabooga
b801e0d50d
Minor changes
2023-01-08 14:37:43 -03:00
oobabooga
a0b1b1beb2
Mention gpt4chan's config.json
2023-01-07 23:13:43 -03:00
oobabooga
f76bdadbed
Add chat mode
2023-01-07 22:52:46 -03:00
oobabooga
c82ccbb24d
Update README
2023-01-07 19:23:59 -03:00
oobabooga
596b40f982
Update readme
2023-01-07 19:22:43 -03:00
oobabooga
0a967bf86d
Link galactica
2023-01-07 19:19:55 -03:00
oobabooga
971fb8e011
Mention the features
2023-01-07 18:40:51 -03:00
oobabooga
b53b658320
Update the README
2023-01-06 20:29:00 -03:00
oobabooga
e5f547fc87
Implement notebook mode
2023-01-06 20:22:26 -03:00
oobabooga
6c02fe7a94
Update the README
2023-01-06 20:09:06 -03:00
oobabooga
eb3aa6b3d7
Update the README
2023-01-06 20:08:43 -03:00
oobabooga
6f2b804de2
Update the README
2023-01-06 20:07:58 -03:00
oobabooga
f3f802454c
Update the README
2023-01-06 20:07:11 -03:00
oobabooga
8f789ed999
Update README
2023-01-06 20:06:24 -03:00
oobabooga
8c3746b629
Add updates to README
2023-01-06 20:00:58 -03:00
oobabooga
ee88d02292
Small fix
2023-01-06 02:13:48 -03:00
oobabooga
d47e518a02
Improve instructions
2023-01-06 02:12:38 -03:00
oobabooga
4142760d56
Better wording
2023-01-06 01:44:40 -03:00
oobabooga
285032da36
Make model loading more transparent
2023-01-06 01:41:52 -03:00
oobabooga
c65bad40dc
Add support for presets
2023-01-06 01:33:21 -03:00
oobabooga
77214d155c
Update
2023-01-06 00:18:34 -03:00
oobabooga
e76727267d
Update
2023-01-06 00:14:33 -03:00
oobabooga
276ef0032d
Mention more models
2023-01-06 00:13:26 -03:00
oobabooga
7daebf91bb
Update
2023-01-06 00:07:51 -03:00
oobabooga
960d881148
Merge branch 'main' of github.com:oobabooga/text-generation-webui
2023-01-06 00:06:48 -03:00
oobabooga
39d47bb8a9
Update the installation instructions ( fixes #1 )
2023-01-06 00:05:11 -03:00
oobabooga
a90097e0b8
Update README.md
2022-12-21 21:49:03 -03:00
oobabooga
e0583f0ec2
Update README.md
2022-12-21 16:52:23 -03:00
oobabooga
261684f92e
Update README.md
2022-12-21 16:49:30 -03:00
oobabooga
65352bc189
Update README.md
2022-12-21 15:00:16 -03:00
oobabooga
e3d7c99987
Update README.md
2022-12-21 14:37:50 -03:00
oobabooga
5018b0fb65
Update README.md
2022-12-21 14:04:51 -03:00
oobabooga
dde76a962f
Initial commit
2022-12-21 13:17:06 -03:00
oobabooga
ad71774a24
Initial commit
2022-12-21 01:17:38 -03:00