Commit Graph

725 Commits

Author SHA1 Message Date
Adam Treat
b24ace372b Add ability to remove models. 2023-05-16 10:31:55 -04:00
Adam Treat
47059ad9f1 Send the prompt template with conversations to the datalake. 2023-05-16 10:31:55 -04:00
Adam Treat
748e7977ca Generate the new prompt/response pair before model loading in server mode. 2023-05-16 10:31:55 -04:00
Adam Treat
f931de21c5 Add save/restore to chatgpt chats and allow serialize/deseralize from disk. 2023-05-16 10:31:55 -04:00
Adam Treat
0cd509d530 Add large network icon background for chatgpt and server modes. 2023-05-16 10:31:55 -04:00
Adam Treat
dd27c10f54 Preliminary support for chatgpt models. 2023-05-16 10:31:55 -04:00
Adam Treat
da3828af89 Use compact json format. 2023-05-16 10:31:55 -04:00
Aaron Miller
d14936bfd6 backend: dedupe tokenizing code in mpt/gptj 2023-05-16 10:30:19 -04:00
Aaron Miller
6182026c70 backend: dedupe tokenizing code in gptj/mpt 2023-05-16 10:30:19 -04:00
Aaron Miller
4cd8bdf9a1 backend: make initial buf_size const in model impls
more unifying mpt and gptj code - this one's never written so also
changing the name to be clearer
2023-05-16 10:30:19 -04:00
Aaron Miller
08402a1b64 mpt: use buf in model struct (thread safety) 2023-05-16 10:30:19 -04:00
AT
3e0ef4c2c5
Update README.md
Signed-off-by: AT <manyoso@users.noreply.github.com>
2023-05-15 19:00:11 -04:00
Andriy Mulyar
a07237e54f
Golang Bindings in README (#586)
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-05-15 12:59:32 -04:00
Ettore Di Giacinto
3f63cc6b47
Golang bindings initial working version(#534)
* WIP

* Fix includes

* Try to fix linking issues

* Refinements

* allow to load MPT and llama models too

* cleanup, add example, add README
2023-05-15 12:45:56 -04:00
Richard Guo
2433902460
label tag warning and moved PR template out of subdir (#584)
Co-authored-by: Richard Guo <richardguo@Richards-MacBook-Pro.local>
2023-05-15 10:15:17 -04:00
Andriy Mulyar
fbe89214b6
Update path for build and run demo (#578)
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-05-14 17:26:28 -04:00
AT
171eee48e2
Update README.md
Signed-off-by: AT <manyoso@users.noreply.github.com>
2023-05-14 15:48:17 -04:00
AT
8f3c88440f
Create README.md
Signed-off-by: AT <manyoso@users.noreply.github.com>
2023-05-14 15:43:18 -04:00
AT
4920816c90
Update README.md
Signed-off-by: AT <manyoso@users.noreply.github.com>
2023-05-14 15:26:00 -04:00
Andriy Mulyar
eb84856344
Rename README to README.md (#575)
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-05-14 14:12:38 -04:00
Andriy Mulyar
782e731e66
Typescript Bindings README (#574)
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-05-14 13:59:03 -04:00
Andriy Mulyar
85d5d138de
Updated Bindings Links (#573)
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-05-14 13:57:00 -04:00
AT
23f433dd18
Update README.md
Signed-off-by: AT <manyoso@users.noreply.github.com>
2023-05-14 07:59:50 -04:00
AT
31452769a4
Update README.md
Signed-off-by: AT <manyoso@users.noreply.github.com>
2023-05-14 07:41:45 -04:00
Adam Treat
b71c0ac3bd The server has different lifetime mgmt than the other chats. 2023-05-13 19:34:54 -04:00
Adam Treat
ddc24acf33 Much better memory mgmt for multi-threaded model loading/unloading. 2023-05-13 19:10:56 -04:00
Adam Treat
2989b74d43 httpserver 2023-05-13 19:07:06 -04:00
Richard Guo
0f71cb6759
Update README.md (#561)
Signed-off-by: Richard Guo <richardg7890@gmail.com>
2023-05-13 14:43:46 -04:00
Andriy Mulyar
f455b2f005
Modal labs python docs (#558)
* Added modal labs example to documentation

* Modal snippet update docs

---------

Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-05-13 13:52:37 -04:00
Andriy Mulyar
d94f37c1bf
Added modal labs example to documentation (#556) 2023-05-13 11:10:18 -04:00
AT
d0bfa6b674 Update README.md
Signed-off-by: AT <manyoso@users.noreply.github.com>
2023-05-13 08:30:11 -04:00
Adam Treat
76675536b0 Cleanup the chatllm properly. 2023-05-12 17:11:52 -04:00
Richard Guo
57ba554478 fixed bug in readme 2023-05-12 15:21:56 -04:00
Richard Guo
befc5d7255 comment out pypi job 2023-05-12 15:21:56 -04:00
Richard Guo
7387be08f6 mpt pypi job 2023-05-12 15:21:56 -04:00
Richard Guo
025bae02a3 gpt4all mpt bindings 2023-05-12 15:21:56 -04:00
Richard Guo
36a6e824f0 mpt bindings 2023-05-12 15:21:56 -04:00
Andriy Mulyar
d56aada08c
Merge pull request #547 from nomic-ai/clear-cloudfront-cache
CircleCI Step to Clear Cloudfront Cache
2023-05-12 12:27:48 -04:00
Richard Guo
def771955d clear cache 2023-05-12 11:18:55 -04:00
Richard Guo
557124e80d working circleci and updated readme 2023-05-12 10:47:46 -04:00
Richard Guo
f4001f2ba8 include own branch for now 2023-05-12 10:47:46 -04:00
Richard Guo
35c124e888 working circleci and updated readme 2023-05-12 10:47:46 -04:00
Richard Guo
907df78553 include own branch for now 2023-05-12 10:47:46 -04:00
Richard Guo
af53e8ee22 working circleci and updated readme 2023-05-12 10:47:46 -04:00
Richard Guo
7df0eb23d4 change path 2023-05-12 10:47:46 -04:00
Richard Guo
29991cfd53 python handler mkdocstrings 2023-05-12 10:47:46 -04:00
Richard Guo
66ac0fc3e5 include own branch for now 2023-05-12 10:47:46 -04:00
Richard Guo
ca4d557c4f docs build 2023-05-12 10:47:46 -04:00
Richard Guo
3bb03ce85b forgot obvious things 2023-05-12 10:21:13 -04:00
AT
834431ebef
Merge pull request #543 from nomic-ai/manyoso-patch-1
Update README.md
2023-05-11 16:49:15 -04:00