Commit Graph

725 Commits

Author SHA1 Message Date
Richard Guo
c4706d0c14
Replit Model (#713)
* porting over replit code model to gpt4all

* replaced memory with kv_self struct

* continuing debug

* welp it built but lot of sus things

* working model loading and somewhat working generate.. need to format response?

* revert back to semi working version

* finally got rid of weird formatting

* figured out problem is with python bindings - this is good to go for testing

* addressing PR feedback

* output refactor

* fixed prompt reponse collection

* cleanup

* addressing PR comments

* building replit backend with new ggmlver code

* chatllm replit and clean python files

* cleanup

* updated replit to match new llmodel api

* match llmodel api and change size_t to Token

* resolve PR comments

* replit model commit comment
2023-06-06 17:09:00 -04:00
Adam Treat
fdffad9efe New release notes 2023-06-05 14:55:59 -04:00
Adam Treat
f5bdf7c94c Bump the version. 2023-06-05 14:32:00 -04:00
Andriy Mulyar
d8e821134e
Revert "Fix bug with resetting context with chatgpt model." (#859)
This reverts commit 031d7149a7.
2023-06-05 14:25:37 -04:00
Adam Treat
ecfeba2710 Revert "Speculative fix for windows llama models with installer."
This reverts commit c99e03e22e.
2023-06-05 14:25:01 -04:00
Adam Treat
c99e03e22e Speculative fix for windows llama models with installer. 2023-06-05 13:21:08 -04:00
AT
da757734ea
Release notes for version 2.4.5 (#853) 2023-06-05 12:10:17 -04:00
Adam Treat
969ff0ee6b Fix installers for windows and linux. 2023-06-05 10:50:16 -04:00
Adam Treat
1d4c8e7091 These need to be installed for them to be packaged and work for both mac and windows. 2023-06-05 09:57:00 -04:00
Adam Treat
3a9cc329b1 Fix compile on mac. 2023-06-05 09:31:57 -04:00
Adam Treat
25eec33bda Try and fix mac. 2023-06-05 09:30:50 -04:00
Adam Treat
91f20becef Need this so the linux installer packages it as a dependency. 2023-06-05 09:23:43 -04:00
Adam Treat
812b2f4b29 Make installers work with mac/windows for big backend change. 2023-06-05 09:23:17 -04:00
Andriy Mulyar
2e5b114364
Update models.json
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-06-04 20:48:45 -04:00
Andriy Mulyar
0db6fd6867
Update models.json (#838)
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-06-04 20:36:12 -04:00
AT
d5cf584f8d
Remove older models that are not as popular. (#837)
* Remove older models that are not as popular.

* Update models.json

Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>

---------

Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
Co-authored-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-06-04 20:26:43 -04:00
Adam Treat
301d2fdbea Fix up for newer models on reset context. This fixes the model from totally failing after a reset context. 2023-06-04 19:31:20 -04:00
Adam Treat
bdba2e8de6 Allow for download of models hosted on third party hosts. 2023-06-04 19:02:43 -04:00
Adam Treat
5073630759 Try again with the url. 2023-06-04 18:39:36 -04:00
Adam Treat
6ba37f47c1 Trying out a new feature to download directly from huggingface. 2023-06-04 18:34:04 -04:00
AT
be3c63ffcd
Update build_and_run.md (#834)
Signed-off-by: AT <manyoso@users.noreply.github.com>
2023-06-04 15:39:32 -04:00
AT
5f95aa9fc6
We no longer have an avx_only repository and better error handling for minimum hardware requirements. (#833) 2023-06-04 15:28:58 -04:00
Adam Treat
9f590db98d Better error handling when the model fails to load. 2023-06-04 14:55:05 -04:00
AT
bbe195ee02
Backend prompt dedup (#822)
* Deduplicated prompt() function code
2023-06-04 08:59:24 -04:00
Adam Treat
bc624f5389 Add a collection immediately and show a placeholder + busy indicator in localdocs settings. 2023-06-03 10:09:17 -04:00
Adam Treat
55055ca983 Add the ability to change the directory via text field not just 'browse' button. 2023-06-02 22:52:55 -04:00
Adam Treat
25ee51e2ca Actually use the theme dark color for window background. 2023-06-02 20:19:50 -04:00
Adam Treat
d9ddd373d6 Prevent flashing of white on resize. 2023-06-02 20:16:11 -04:00
Adam Treat
8aba76ad05 Min constraints on about dialog. 2023-06-02 20:05:47 -04:00
Adam Treat
a7f74e9d01 Some tweaks to UI to make window resizing smooth and flow nicely. 2023-06-02 20:00:28 -04:00
niansa/tuxifan
f3564ac6b9
Fixed tons of warnings and clazy findings (#811) 2023-06-02 15:46:41 -04:00
niansa/tuxifan
f0be66a221 Fixed spelling error in models.json
to make CI happy

Signed-off-by: niansa/tuxifan <tuxifan@posteo.de>
2023-06-02 12:31:09 -04:00
Adam Treat
be9f6ad543 Add models/release.json to github repo to allow PRs 2023-06-02 11:10:00 -04:00
Adam Treat
188770c92a Remove this as it is no longer useful. 2023-06-02 08:19:18 -04:00
Adam Treat
a41bd6ac0a Trying to shrink the copy+paste code and do more code sharing between backend model impl. 2023-06-02 07:20:59 -04:00
Adam Treat
031d7149a7 Fix bug with resetting context with chatgpt model. 2023-06-01 17:34:13 -04:00
Adam Treat
94633da2d7 Don't hardcode these. 2023-06-01 17:23:57 -04:00
Adam Treat
28944ac01b Fix for stale references after we regenerate. 2023-06-01 17:23:57 -04:00
Adam Treat
aea94f756d Better name for database results. 2023-06-01 17:14:17 -04:00
Adam Treat
f62e439a2d Make localdocs work with server mode. 2023-06-01 17:14:17 -04:00
Adam Treat
20eff29432 Logger should also output to stderr 2023-06-01 14:15:11 -04:00
Adam Treat
f74363bb3a Fix compile 2023-06-01 10:58:31 -04:00
niansa/tuxifan
ddb5fa718d
Implemented logging mechanism (#785) 2023-06-01 16:50:42 +02:00
niansa
a3d08cdcd5 Dlopen better implementation management (Version 2) 2023-06-01 07:44:15 -04:00
Adam Treat
cae757aacd Make all the toolbuttons highlight on hover. 2023-05-31 21:07:14 -04:00
Adam Treat
93a05c8834 Fixup the plus new chat button. 2023-05-31 20:42:00 -04:00
Adam Treat
ae51e3f6fa Use the proper text color for sending messages. 2023-05-31 20:31:59 -04:00
Adam Treat
95244a4d78 Fix warning. 2023-05-31 20:09:05 -04:00
Adam Treat
220e5547db Draw the indicator for combobox to ensure it looks the same on all platforms. 2023-05-31 19:55:16 -04:00
Adam Treat
1370995b92 Add a custom busy indicator to further align look and feel across platforms. 2023-05-31 19:28:09 -04:00
AT
48275d0dcc
Dlopen backend 5 (#779)
Major change to the backend that allows for pluggable versions of llama.cpp/ggml. This was squashed merged from dlopen_backend_5 where the history is preserved.
2023-05-31 17:04:01 -04:00
Adam Treat
f4a1f7340c Fix offset of prompt/response icons for smaller text. 2023-05-31 14:26:59 -04:00
Adam Treat
5f940208e4 Make the comboboxes align in UI. 2023-05-30 21:11:04 -04:00
Adam Treat
64ec93d59b Some color and theme enhancements to make the UI contrast a bit better. 2023-05-30 21:03:40 -04:00
Adam Treat
e756675d56 Fix wording of this accessible description. 2023-05-30 20:01:12 -04:00
Adam Treat
3e828e1e4b Add a hover and pressed to the visual indication of MyButton. 2023-05-30 19:58:37 -04:00
Adam Treat
122b14d526 Use the new MyButton for the regenerate response button. 2023-05-30 19:10:38 -04:00
Adam Treat
7aed367c68 Add a label to the model loading visual indicator. 2023-05-30 18:24:26 -04:00
Adam Treat
912cb2a842 Get rid of blocking behavior for regenerate response. 2023-05-30 18:17:59 -04:00
FoivosC
337c7fecac construct and return the correct reponse when the request is a chat completion 2023-05-30 16:34:23 -04:00
Adam Treat
d9f5626481 Fix remove model from model download for regular models. 2023-05-30 16:16:09 -04:00
Adam Treat
810a3b12cc This time remember to bump the version right after a release. 2023-05-25 18:26:33 -04:00
Adam Treat
d1ff7132c5 Bump the version number. 2023-05-25 17:08:50 -04:00
Adam Treat
afe3870b7a Libraries named differently on msvc. 2023-05-25 16:27:09 -04:00
Adam Treat
474c5387f9 Get the backend as well as the client building/working with msvc. 2023-05-25 15:22:45 -04:00
Adam Treat
265488e54a Add a newline 2023-05-25 11:28:06 -04:00
Adam Treat
98201540a2 Various fixes to remove unnecessary warnings. 2023-05-25 11:28:06 -04:00
Adam Treat
0403a122ca Don't use the full path in reference text. 2023-05-25 11:28:06 -04:00
Adam Treat
9b0629db8b Add context link to references. 2023-05-25 11:28:06 -04:00
Adam Treat
db9eecdce4 Store the references separately so they are not sent to datalake. 2023-05-25 11:28:06 -04:00
Adam Treat
b5380c9b7f Adds the collections to serialize and implement references for localdocs. 2023-05-25 11:28:06 -04:00
Adam Treat
d81302950e Complete the settings for localdocs. 2023-05-25 11:28:06 -04:00
Adam Treat
01b8c7617f Add more of the UI for selecting collections for chats. 2023-05-25 11:28:06 -04:00
Adam Treat
2827c5876c Clean up the settings dialog for localdocs a bit. 2023-05-25 11:28:06 -04:00
Adam Treat
d555ed3b07 Begin implementing the localdocs ui in earnest. 2023-05-25 11:28:06 -04:00
Adam Treat
120fbbf67d Start fleshing out the localdocs ui. 2023-05-25 11:28:06 -04:00
Adam Treat
af33be7b3e Add a localdocs tab. 2023-05-25 11:28:06 -04:00
Adam Treat
d9eddbec45 Add a collection list to support a UI. 2023-05-25 11:28:06 -04:00
Adam Treat
68ba9c564b Specify a large number of suffixes we will search for now. 2023-05-25 11:28:06 -04:00
Adam Treat
c800291e7f Add prompt processing and localdocs to the busy indicator in UI. 2023-05-25 11:28:06 -04:00
Adam Treat
618895f0a1 Turn off the debugging messages by default. 2023-05-25 11:28:06 -04:00
Adam Treat
c6df4645c8 Add a new muted text color. 2023-05-25 11:28:06 -04:00
Adam Treat
54fc980cb5 Cleanup of the database, better chunking, better matching. 2023-05-25 11:28:06 -04:00
Adam Treat
5f533e76a1 Remove this signal as unnecessary for now. 2023-05-25 11:28:06 -04:00
Adam Treat
e70a1c458b Add remove folder implementation. 2023-05-25 11:28:06 -04:00
Adam Treat
d88eddbc20 Fixup the rescan. Fix debug output. 2023-05-25 11:28:06 -04:00
Adam Treat
7e42af5f33 localdocs 2023-05-25 11:28:06 -04:00
Adam Treat
b36a520207 Fix the build. 2023-05-23 18:20:17 -04:00
Adam Treat
bcce93555a Small cleanups for settings dialog. 2023-05-23 14:53:01 -04:00
Justin Wang
5305bce59a fix typo so padding can be accessed 2023-05-23 13:57:51 -04:00
Justin Wang
d7ab4c0e2d change accessible description for thumbs up button 2023-05-23 12:15:54 -04:00
Justin Wang
a19ef751dc add missing accessible props for buttons, remove forgotten duplicate accessible props 2023-05-23 12:15:54 -04:00
Justin Wang
e3d6eb334b dedup qml: move accessible properties to MyButton 2023-05-23 12:15:54 -04:00
Justin Wang
eb6a7cca47 dedup qml: convert more buttons to MyButton 2023-05-23 11:03:32 -04:00
Adam Treat
8e705d730d Minor tweaks to look and feel for some dialogs and button. 2023-05-22 22:20:16 -04:00
Justin Wang
2ce22208a3 deduplicate qml: create and use MyCheckBox and MyTextField 2023-05-22 18:03:13 -04:00
Justin Wang
15b3e0d3f6 remove padding 2023-05-22 17:22:05 -04:00
Justin Wang
28b0455451 replace buttons with MyButton 2023-05-22 17:22:05 -04:00
Adam Treat
5c1cf69b8b Start to deduplicate code in qml. 2023-05-22 14:25:43 -04:00
Adam Treat
cfb45274e0 Fix the tabs so they don't have a double border on the bottom. 2023-05-22 09:04:37 -04:00
Adam Treat
d9698436df Fix the dialog so it opens on the correct folder. 2023-05-22 09:04:25 -04:00
Juuso Alasuutari
81fdc28e58 llmodel: constify LLModel::threadCount() 2023-05-22 08:54:46 -04:00
Andriy Mulyar
914519e772
Update build_and_run.md (#636)
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-05-18 21:40:17 -04:00
Shukri
bce2b3025b Fix typo in README 2023-05-17 09:56:20 -04:00
Adam Treat
a86a1aea6b Fix for windows/mac installers. 2023-05-16 13:06:42 -04:00
Adam Treat
7221169eff Remove davinci-003 option. 2023-05-16 13:06:42 -04:00
Adam Treat
86b6d40d08 Bump the version. 2023-05-16 13:06:42 -04:00
Yaroslav Halchenko
e4bc9c0c3b fix ambigous typo 2023-05-16 11:33:59 -04:00
Adam Treat
79d6243fe1 Use the default for max_tokens to avoid errors. 2023-05-16 10:31:55 -04:00
Adam Treat
b24ace372b Add ability to remove models. 2023-05-16 10:31:55 -04:00
Adam Treat
47059ad9f1 Send the prompt template with conversations to the datalake. 2023-05-16 10:31:55 -04:00
Adam Treat
748e7977ca Generate the new prompt/response pair before model loading in server mode. 2023-05-16 10:31:55 -04:00
Adam Treat
f931de21c5 Add save/restore to chatgpt chats and allow serialize/deseralize from disk. 2023-05-16 10:31:55 -04:00
Adam Treat
0cd509d530 Add large network icon background for chatgpt and server modes. 2023-05-16 10:31:55 -04:00
Adam Treat
dd27c10f54 Preliminary support for chatgpt models. 2023-05-16 10:31:55 -04:00
Adam Treat
da3828af89 Use compact json format. 2023-05-16 10:31:55 -04:00
Adam Treat
b71c0ac3bd The server has different lifetime mgmt than the other chats. 2023-05-13 19:34:54 -04:00
Adam Treat
ddc24acf33 Much better memory mgmt for multi-threaded model loading/unloading. 2023-05-13 19:10:56 -04:00
Adam Treat
2989b74d43 httpserver 2023-05-13 19:07:06 -04:00
Adam Treat
76675536b0 Cleanup the chatllm properly. 2023-05-12 17:11:52 -04:00
Adam Treat
4a2e3e55ae Fix typo. 2023-05-11 16:48:20 -04:00
AT
2c5e2bf1ee
Update README.md 2023-05-11 15:31:01 -04:00
AT
507a96b2f3
Update README.md 2023-05-10 12:10:33 -04:00
Adam Treat
d918b02c29 Move the llmodel C API to new top-level directory and version it. 2023-05-10 11:46:40 -04:00
Adam Treat
6015154bef Moving everything to subdir for monorepo merge. 2023-05-10 10:26:55 -04:00