186 Commits

Author	SHA1	Message	Date
oobabooga	056717923f	Document StreamingLLM	2024-03-10 19:15:23 -07:00
Bartowski	104573f7d4	Update cache_4bit documentation (#5649) ... --------- Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>	2024-03-07 13:08:21 -03:00
oobabooga	527ba98105	Do not install extensions requirements by default (#5621)	2024-03-04 04:46:39 -03:00
oobabooga	acfbe6b3b3	Minor doc changes	2024-02-06 06:35:01 -08:00
oobabooga	8a6d9abb41	Small fixes	2024-02-06 06:26:27 -08:00
oobabooga	8c35fefb3b	Add custom sampler order support (#5443)	2024-02-06 11:20:10 -03:00
oobabooga	cd4ffd3dd4	Update docs	2024-02-04 18:48:04 -08:00
kalomaze	b6077b02e4	Quadratic sampling (#5403) ... --------- Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>	2024-02-04 00:20:02 -03:00
oobabooga	70648e75e6	Docs: minor change	2024-01-26 06:00:26 -08:00
oobabooga	ec2da5adef	Docs: document keyboard shortcuts	2024-01-10 03:58:39 -08:00
oobabooga	fbce30b09f	Reduce the number of built-in presets (#5217)	2024-01-09 11:50:10 -03:00
oobabooga	29c2693ea0	dynatemp_low, dynatemp_high, dynatemp_exponent parameters (#5209)	2024-01-08 23:28:35 -03:00
oobabooga	0d07b3a6a1	Add dynamic_temperature_low parameter (#5198)	2024-01-07 17:03:47 -03:00
kalomaze	48327cc5c4	Dynamic Temperature HF loader support (#5174) ... --------- Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>	2024-01-07 10:36:26 -03:00
oobabooga	0e54a09bcb	Remove exllamav1 loaders (#5128)	2023-12-31 01:57:06 -03:00
oobabooga	eaa1fe67f3	Remove elevenlabs extension (#4928)	2023-12-15 00:00:07 -03:00
oobabooga	fade6abfe9	Update README	2023-12-13 22:18:40 -08:00
oobabooga	b2cae6cac6	Docs: minor update	2023-12-12 14:11:13 -08:00
oobabooga	12f58e2cac	Merge remote-tracking branch 'refs/remotes/origin/dev' into dev	2023-12-12 13:28:24 -08:00
oobabooga	1c531a3713	Minor cleanup	2023-12-12 13:25:21 -08:00
Penagwin	85a1d8965c	Updated Docker Docs (#4900)	2023-12-12 18:03:50 -03:00
oobabooga	39d2fe1ed9	Jinja templates for Instruct and Chat (#4874)	2023-12-12 17:23:14 -03:00
oobabooga	78af3b0a00	Update docs/What Works.md	2023-11-19 07:57:16 -08:00
oobabooga	0fa1af296c	Add /v1/internal/logits endpoint (#4650)	2023-11-18 23:19:31 -03:00
oobabooga	83b64e7fc1	New feature: "random preset" button (#4647)	2023-11-18 18:31:41 -03:00
oobabooga	d1a58da52f	Update ancient Docker instructions	2023-11-17 19:52:53 -08:00
oobabooga	9d6f79db74	Revert "Bump llama-cpp-python to 0.2.18 (#4611)" ... This reverts commit 923c8e25fb.	2023-11-17 05:14:25 -08:00
oobabooga	8b66d83aa9	Set use_fast=True by default, create --no_use_fast flag ... This increases tokens/second for HF loaders.	2023-11-16 19:55:28 -08:00
oobabooga	94b7177174	Update docs/07 - Extensions	2023-11-16 18:24:46 -08:00
oobabooga	923c8e25fb	Bump llama-cpp-python to 0.2.18 (#4611)	2023-11-16 22:55:14 -03:00
David Nielson	564d0cde82	Use standard hyphens in filenames (#4576)	2023-11-15 20:29:00 -03:00
oobabooga	c5be3f7acb	Make /v1/embeddings functional, add request/response types	2023-11-10 07:34:27 -08:00
oobabooga	7ed2143cd6	Update 12 - OpenAI API.md	2023-11-10 11:56:04 -03:00
oobabooga	4aabff3728	Remove old API, launch OpenAI API with --api	2023-11-10 06:39:08 -08:00
oobabooga	21ed9a260e	Document the new "Custom system message" field	2023-11-08 17:54:10 -08:00
oobabooga	322c170566	Document logits_all	2023-11-07 14:45:11 -08:00
oobabooga	0c440877de	Update 12 - OpenAI API.md	2023-11-07 12:59:40 -03:00
oobabooga	55dc9845cb	Update 12 - OpenAI API.md	2023-11-07 12:51:41 -03:00
oobabooga	b0b999dd68	Merge remote-tracking branch 'refs/remotes/origin/dev' into dev	2023-11-07 07:46:08 -08:00
oobabooga	2bda1a9c9b	Mention --api-key	2023-11-07 07:45:55 -08:00
oobabooga	cc04abda49	Update 12 - OpenAI API.md	2023-11-07 12:40:52 -03:00
oobabooga	ddca6948b2	Update 12 - OpenAI API.md	2023-11-07 12:39:59 -03:00
oobabooga	40e73aafce	Update 12 - OpenAI API.md	2023-11-07 12:38:39 -03:00
oobabooga	6ec997f195	Update 12 - OpenAI API.md	2023-11-07 12:36:52 -03:00
oobabooga	15d4ea180d	Merge remote-tracking branch 'refs/remotes/origin/dev' into dev	2023-11-07 07:35:36 -08:00
oobabooga	b2afdda4e8	Add more API examples	2023-11-07 07:35:04 -08:00
Morgan Cheng	349604458b	Update 12 - OpenAI API.md (#4501) ... Fix the typo in argument. It should be `--api-port` instead of `--port`. Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>	2023-11-07 11:22:17 -03:00
oobabooga	ceb8c92dfc	Update 12 - OpenAI API.md	2023-11-06 10:38:22 -03:00
oobabooga	ec17a5d2b7	Make OpenAI API the default API (#4430)	2023-11-06 02:38:29 -03:00
oobabooga	fb3bd0203d	Update docs	2023-11-04 11:02:24 -07:00