Anton Rogozin
|
8a9d5a0cea
|
update AutoGPTQ to higher version for lora applying error fixing (#4604)
|
2023-11-15 20:23:22 -03:00 |
|
oobabooga
|
072cfe19e9
|
Minor Colab fix
|
2023-11-15 08:18:32 -08:00 |
|
oobabooga
|
3d861a459d
|
Minor Colab fix
|
2023-11-15 08:15:43 -08:00 |
|
oobabooga
|
dea90c7b67
|
Bump exllamav2 to 0.0.8
|
2023-11-13 10:34:10 -08:00 |
|
oobabooga
|
4f9bc63edf
|
Installer: update a message for clarity
|
2023-11-10 09:43:02 -08:00 |
|
oobabooga
|
74fee4f312
|
Update Colab-TextGen-GPU.ipynb
|
2023-11-10 09:18:25 -08:00 |
|
oobabooga
|
52758f15da
|
Remove sentence-transformers requirement (for #1575)
|
2023-11-10 07:35:29 -08:00 |
|
oobabooga
|
c5be3f7acb
|
Make /v1/embeddings functional, add request/response types
|
2023-11-10 07:34:27 -08:00 |
|
oobabooga
|
7ed2143cd6
|
Update 12 - OpenAI API.md
|
2023-11-10 11:56:04 -03:00 |
|
oobabooga
|
0777b0d3c7
|
Add system_message parameter, document model (unused) parameter
|
2023-11-10 06:47:18 -08:00 |
|
oobabooga
|
4aabff3728
|
Remove old API, launch OpenAI API with --api
|
2023-11-10 06:39:08 -08:00 |
|
GuizzyQC
|
6a7cd01ebf
|
Fix bug with /internal/model/load (#4549)
Update shared.model_name after loading model through API call
|
2023-11-10 00:16:38 -03:00 |
|
oobabooga
|
2af7e382b1
|
Revert "Bump llama-cpp-python to 0.2.14"
This reverts commit 5c3eb22ce6 .
The new version has issues:
https://github.com/oobabooga/text-generation-webui/issues/4540
https://github.com/abetlen/llama-cpp-python/issues/893
|
2023-11-09 10:02:13 -08:00 |
|
oobabooga
|
07d66e45b4
|
Merge pull request #4541 from oobabooga/dev
Merge dev branch
|
2023-11-09 14:53:34 -03:00 |
|
Ashley Kleynhans
|
372d712921
|
Fix deprecated API (#4539)
|
2023-11-09 14:51:50 -03:00 |
|
oobabooga
|
d86f1fd2c3
|
OpenAI API: stop streaming on client disconnect (closes #4521)
|
2023-11-09 06:37:32 -08:00 |
|
oobabooga
|
f7534b2f4b
|
Merge pull request #4532 from oobabooga/dev
Merge dev branch
|
2023-11-09 09:33:55 -03:00 |
|
oobabooga
|
effb3aef42
|
Prevent deadlocks in OpenAI API with simultaneous requests
|
2023-11-08 20:55:39 -08:00 |
|
oobabooga
|
4da00b6032
|
Merge pull request #4522 from oobabooga/dev
Merge dev branch
|
2023-11-08 22:57:08 -03:00 |
|
oobabooga
|
21ed9a260e
|
Document the new "Custom system message" field
|
2023-11-08 17:54:10 -08:00 |
|
oobabooga
|
678fd73aef
|
Document /v1/internal/model/load and fix a bug
|
2023-11-08 17:41:12 -08:00 |
|
MrMojoR
|
1754a3761b
|
Include trust remote code usage in openai api's embedder (#4513)
|
2023-11-08 11:25:43 -03:00 |
|
hronoas
|
6c7aad11f3
|
openai extension: wrong frequency_penalty type (#4512)
|
2023-11-08 11:23:51 -03:00 |
|
oobabooga
|
881e8a6e70
|
Small bug fix in /v1/internal/model/load
|
2023-11-08 02:34:13 -03:00 |
|
oobabooga
|
050ff36bd6
|
Revert "Add a comment to /v1/models"
This reverts commit 38b07493a0 .
|
2023-11-07 21:09:47 -08:00 |
|
oobabooga
|
38b07493a0
|
Add a comment to /v1/models
|
2023-11-07 21:07:12 -08:00 |
|
oobabooga
|
2358706453
|
Add /v1/internal/model/load endpoint (tentative)
|
2023-11-07 20:58:06 -08:00 |
|
oobabooga
|
43c53a7820
|
Refactor the /v1/models endpoint
|
2023-11-07 19:59:27 -08:00 |
|
oobabooga
|
1b69694fe9
|
Add types to the encode/decode/token-count endpoints
|
2023-11-07 19:32:14 -08:00 |
|
oobabooga
|
f6ca9cfcdc
|
Add /v1/internal/model-info endpoint
|
2023-11-07 18:59:02 -08:00 |
|
oobabooga
|
6e2e0317af
|
Separate context and system message in instruction formats (#4499)
|
2023-11-07 20:02:58 -03:00 |
|
oobabooga
|
322c170566
|
Document logits_all
|
2023-11-07 14:45:11 -08:00 |
|
oobabooga
|
5c0559da69
|
Training: fix .txt files now showing in dropdowns
|
2023-11-07 14:41:11 -08:00 |
|
oobabooga
|
af3d25a503
|
Disable logits_all in llamacpp_HF (makes processing 3x faster)
|
2023-11-07 14:35:48 -08:00 |
|
oobabooga
|
5c3eb22ce6
|
Bump llama-cpp-python to 0.2.14
|
2023-11-07 14:20:43 -08:00 |
|
oobabooga
|
3fc505dc0f
|
Document unused parameters
|
2023-11-07 08:56:09 -08:00 |
|
oobabooga
|
3d59346871
|
Implement echo/suffix parameters
|
2023-11-07 08:43:45 -08:00 |
|
oobabooga
|
cee099f131
|
Merge remote-tracking branch 'refs/remotes/origin/dev' into dev
|
2023-11-07 08:25:22 -08:00 |
|
oobabooga
|
48c9c31440
|
Document the "preset" option in the API
|
2023-11-07 08:23:17 -08:00 |
|
oobabooga
|
d59f1ad89a
|
Update README.md
|
2023-11-07 13:05:06 -03:00 |
|
oobabooga
|
0c440877de
|
Update 12 - OpenAI API.md
|
2023-11-07 12:59:40 -03:00 |
|
oobabooga
|
55dc9845cb
|
Update 12 - OpenAI API.md
|
2023-11-07 12:51:41 -03:00 |
|
oobabooga
|
b0b999dd68
|
Merge remote-tracking branch 'refs/remotes/origin/dev' into dev
|
2023-11-07 07:46:08 -08:00 |
|
oobabooga
|
2bda1a9c9b
|
Mention --api-key
|
2023-11-07 07:45:55 -08:00 |
|
oobabooga
|
cc04abda49
|
Update 12 - OpenAI API.md
|
2023-11-07 12:40:52 -03:00 |
|
oobabooga
|
ddca6948b2
|
Update 12 - OpenAI API.md
|
2023-11-07 12:39:59 -03:00 |
|
oobabooga
|
40e73aafce
|
Update 12 - OpenAI API.md
|
2023-11-07 12:38:39 -03:00 |
|
oobabooga
|
6ec997f195
|
Update 12 - OpenAI API.md
|
2023-11-07 12:36:52 -03:00 |
|
oobabooga
|
15d4ea180d
|
Merge remote-tracking branch 'refs/remotes/origin/dev' into dev
|
2023-11-07 07:35:36 -08:00 |
|
oobabooga
|
b2afdda4e8
|
Add more API examples
|
2023-11-07 07:35:04 -08:00 |
|