Commit Graph

187 Commits

Author SHA1 Message Date
oobabooga
35da6b989d
Organize the parameters tab (#5767) 2024-03-28 16:45:03 -03:00
oobabooga
056717923f Document StreamingLLM 2024-03-10 19:15:23 -07:00
Bartowski
104573f7d4
Update cache_4bit documentation (#5649)
---------

Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
2024-03-07 13:08:21 -03:00
oobabooga
527ba98105
Do not install extensions requirements by default (#5621) 2024-03-04 04:46:39 -03:00
oobabooga
acfbe6b3b3 Minor doc changes 2024-02-06 06:35:01 -08:00
oobabooga
8a6d9abb41 Small fixes 2024-02-06 06:26:27 -08:00
oobabooga
8c35fefb3b
Add custom sampler order support (#5443) 2024-02-06 11:20:10 -03:00
oobabooga
cd4ffd3dd4 Update docs 2024-02-04 18:48:04 -08:00
kalomaze
b6077b02e4
Quadratic sampling (#5403)
---------

Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
2024-02-04 00:20:02 -03:00
oobabooga
70648e75e6 Docs: minor change 2024-01-26 06:00:26 -08:00
oobabooga
ec2da5adef Docs: document keyboard shortcuts 2024-01-10 03:58:39 -08:00
oobabooga
fbce30b09f
Reduce the number of built-in presets (#5217) 2024-01-09 11:50:10 -03:00
oobabooga
29c2693ea0
dynatemp_low, dynatemp_high, dynatemp_exponent parameters (#5209) 2024-01-08 23:28:35 -03:00
oobabooga
0d07b3a6a1
Add dynamic_temperature_low parameter (#5198) 2024-01-07 17:03:47 -03:00
kalomaze
48327cc5c4
Dynamic Temperature HF loader support (#5174)
---------

Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
2024-01-07 10:36:26 -03:00
oobabooga
0e54a09bcb
Remove exllamav1 loaders (#5128) 2023-12-31 01:57:06 -03:00
oobabooga
eaa1fe67f3
Remove elevenlabs extension (#4928) 2023-12-15 00:00:07 -03:00
oobabooga
fade6abfe9 Update README 2023-12-13 22:18:40 -08:00
oobabooga
b2cae6cac6 Docs: minor update 2023-12-12 14:11:13 -08:00
oobabooga
12f58e2cac Merge remote-tracking branch 'refs/remotes/origin/dev' into dev 2023-12-12 13:28:24 -08:00
oobabooga
1c531a3713 Minor cleanup 2023-12-12 13:25:21 -08:00
Penagwin
85a1d8965c
Updated Docker Docs (#4900) 2023-12-12 18:03:50 -03:00
oobabooga
39d2fe1ed9
Jinja templates for Instruct and Chat (#4874) 2023-12-12 17:23:14 -03:00
oobabooga
78af3b0a00 Update docs/What Works.md 2023-11-19 07:57:16 -08:00
oobabooga
0fa1af296c
Add /v1/internal/logits endpoint (#4650) 2023-11-18 23:19:31 -03:00
oobabooga
83b64e7fc1
New feature: "random preset" button (#4647) 2023-11-18 18:31:41 -03:00
oobabooga
d1a58da52f Update ancient Docker instructions 2023-11-17 19:52:53 -08:00
oobabooga
9d6f79db74 Revert "Bump llama-cpp-python to 0.2.18 (#4611)"
This reverts commit 923c8e25fb.
2023-11-17 05:14:25 -08:00
oobabooga
8b66d83aa9 Set use_fast=True by default, create --no_use_fast flag
This increases tokens/second for HF loaders.
2023-11-16 19:55:28 -08:00
oobabooga
94b7177174 Update docs/07 - Extensions 2023-11-16 18:24:46 -08:00
oobabooga
923c8e25fb
Bump llama-cpp-python to 0.2.18 (#4611) 2023-11-16 22:55:14 -03:00
David Nielson
564d0cde82
Use standard hyphens in filenames (#4576) 2023-11-15 20:29:00 -03:00
oobabooga
c5be3f7acb Make /v1/embeddings functional, add request/response types 2023-11-10 07:34:27 -08:00
oobabooga
7ed2143cd6
Update 12 - OpenAI API.md 2023-11-10 11:56:04 -03:00
oobabooga
4aabff3728 Remove old API, launch OpenAI API with --api 2023-11-10 06:39:08 -08:00
oobabooga
21ed9a260e Document the new "Custom system message" field 2023-11-08 17:54:10 -08:00
oobabooga
322c170566 Document logits_all 2023-11-07 14:45:11 -08:00
oobabooga
0c440877de
Update 12 - OpenAI API.md 2023-11-07 12:59:40 -03:00
oobabooga
55dc9845cb
Update 12 - OpenAI API.md 2023-11-07 12:51:41 -03:00
oobabooga
b0b999dd68 Merge remote-tracking branch 'refs/remotes/origin/dev' into dev 2023-11-07 07:46:08 -08:00
oobabooga
2bda1a9c9b Mention --api-key 2023-11-07 07:45:55 -08:00
oobabooga
cc04abda49
Update 12 - OpenAI API.md 2023-11-07 12:40:52 -03:00
oobabooga
ddca6948b2
Update 12 - OpenAI API.md 2023-11-07 12:39:59 -03:00
oobabooga
40e73aafce
Update 12 - OpenAI API.md 2023-11-07 12:38:39 -03:00
oobabooga
6ec997f195
Update 12 - OpenAI API.md 2023-11-07 12:36:52 -03:00
oobabooga
15d4ea180d Merge remote-tracking branch 'refs/remotes/origin/dev' into dev 2023-11-07 07:35:36 -08:00
oobabooga
b2afdda4e8 Add more API examples 2023-11-07 07:35:04 -08:00
Morgan Cheng
349604458b
Update 12 - OpenAI API.md (#4501)
Fix the typo in argument. It should be `--api-port` instead of `--port`.

Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
2023-11-07 11:22:17 -03:00
oobabooga
ceb8c92dfc
Update 12 - OpenAI API.md 2023-11-06 10:38:22 -03:00
oobabooga
ec17a5d2b7
Make OpenAI API the default API (#4430) 2023-11-06 02:38:29 -03:00