Richard Guo
c4706d0c14
Replit Model ( #713 )
...
* porting over replit code model to gpt4all
* replaced memory with kv_self struct
* continuing debug
* welp it built but lot of sus things
* working model loading and somewhat working generate.. need to format response?
* revert back to semi working version
* finally got rid of weird formatting
* figured out problem is with python bindings - this is good to go for testing
* addressing PR feedback
* output refactor
* fixed prompt reponse collection
* cleanup
* addressing PR comments
* building replit backend with new ggmlver code
* chatllm replit and clean python files
* cleanup
* updated replit to match new llmodel api
* match llmodel api and change size_t to Token
* resolve PR comments
* replit model commit comment
2023-06-06 17:09:00 -04:00
Adam Treat
fdffad9efe
New release notes
2023-06-05 14:55:59 -04:00
Adam Treat
f5bdf7c94c
Bump the version.
2023-06-05 14:32:00 -04:00
Andriy Mulyar
d8e821134e
Revert "Fix bug with resetting context with chatgpt model." ( #859 )
...
This reverts commit 031d7149a7
.
2023-06-05 14:25:37 -04:00
Adam Treat
ecfeba2710
Revert "Speculative fix for windows llama models with installer."
...
This reverts commit c99e03e22e
.
2023-06-05 14:25:01 -04:00
Adam Treat
c99e03e22e
Speculative fix for windows llama models with installer.
2023-06-05 13:21:08 -04:00
AT
da757734ea
Release notes for version 2.4.5 ( #853 )
2023-06-05 12:10:17 -04:00
Adam Treat
969ff0ee6b
Fix installers for windows and linux.
2023-06-05 10:50:16 -04:00
Adam Treat
1d4c8e7091
These need to be installed for them to be packaged and work for both mac and windows.
2023-06-05 09:57:00 -04:00
Adam Treat
3a9cc329b1
Fix compile on mac.
2023-06-05 09:31:57 -04:00
Adam Treat
25eec33bda
Try and fix mac.
2023-06-05 09:30:50 -04:00
Adam Treat
91f20becef
Need this so the linux installer packages it as a dependency.
2023-06-05 09:23:43 -04:00
Adam Treat
812b2f4b29
Make installers work with mac/windows for big backend change.
2023-06-05 09:23:17 -04:00
Andriy Mulyar
2e5b114364
Update models.json
...
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-06-04 20:48:45 -04:00
Andriy Mulyar
0db6fd6867
Update models.json ( #838 )
...
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-06-04 20:36:12 -04:00
AT
d5cf584f8d
Remove older models that are not as popular. ( #837 )
...
* Remove older models that are not as popular.
* Update models.json
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
---------
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
Co-authored-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-06-04 20:26:43 -04:00
Adam Treat
301d2fdbea
Fix up for newer models on reset context. This fixes the model from totally failing after a reset context.
2023-06-04 19:31:20 -04:00
Adam Treat
bdba2e8de6
Allow for download of models hosted on third party hosts.
2023-06-04 19:02:43 -04:00
Adam Treat
5073630759
Try again with the url.
2023-06-04 18:39:36 -04:00
Adam Treat
6ba37f47c1
Trying out a new feature to download directly from huggingface.
2023-06-04 18:34:04 -04:00
AT
be3c63ffcd
Update build_and_run.md ( #834 )
...
Signed-off-by: AT <manyoso@users.noreply.github.com>
2023-06-04 15:39:32 -04:00
AT
5f95aa9fc6
We no longer have an avx_only repository and better error handling for minimum hardware requirements. ( #833 )
2023-06-04 15:28:58 -04:00
Adam Treat
9f590db98d
Better error handling when the model fails to load.
2023-06-04 14:55:05 -04:00
AT
bbe195ee02
Backend prompt dedup ( #822 )
...
* Deduplicated prompt() function code
2023-06-04 08:59:24 -04:00
Adam Treat
bc624f5389
Add a collection immediately and show a placeholder + busy indicator in localdocs settings.
2023-06-03 10:09:17 -04:00
Adam Treat
55055ca983
Add the ability to change the directory via text field not just 'browse' button.
2023-06-02 22:52:55 -04:00
Adam Treat
25ee51e2ca
Actually use the theme dark color for window background.
2023-06-02 20:19:50 -04:00
Adam Treat
d9ddd373d6
Prevent flashing of white on resize.
2023-06-02 20:16:11 -04:00
Adam Treat
8aba76ad05
Min constraints on about dialog.
2023-06-02 20:05:47 -04:00
Adam Treat
a7f74e9d01
Some tweaks to UI to make window resizing smooth and flow nicely.
2023-06-02 20:00:28 -04:00
niansa/tuxifan
f3564ac6b9
Fixed tons of warnings and clazy findings ( #811 )
2023-06-02 15:46:41 -04:00
niansa/tuxifan
f0be66a221
Fixed spelling error in models.json
...
to make CI happy
Signed-off-by: niansa/tuxifan <tuxifan@posteo.de>
2023-06-02 12:31:09 -04:00
Adam Treat
be9f6ad543
Add models/release.json to github repo to allow PRs
2023-06-02 11:10:00 -04:00
Adam Treat
188770c92a
Remove this as it is no longer useful.
2023-06-02 08:19:18 -04:00
Adam Treat
a41bd6ac0a
Trying to shrink the copy+paste code and do more code sharing between backend model impl.
2023-06-02 07:20:59 -04:00
Adam Treat
031d7149a7
Fix bug with resetting context with chatgpt model.
2023-06-01 17:34:13 -04:00
Adam Treat
94633da2d7
Don't hardcode these.
2023-06-01 17:23:57 -04:00
Adam Treat
28944ac01b
Fix for stale references after we regenerate.
2023-06-01 17:23:57 -04:00
Adam Treat
aea94f756d
Better name for database results.
2023-06-01 17:14:17 -04:00
Adam Treat
f62e439a2d
Make localdocs work with server mode.
2023-06-01 17:14:17 -04:00
Adam Treat
20eff29432
Logger should also output to stderr
2023-06-01 14:15:11 -04:00
Adam Treat
f74363bb3a
Fix compile
2023-06-01 10:58:31 -04:00
niansa/tuxifan
ddb5fa718d
Implemented logging mechanism ( #785 )
2023-06-01 16:50:42 +02:00
niansa
a3d08cdcd5
Dlopen better implementation management (Version 2)
2023-06-01 07:44:15 -04:00
Adam Treat
cae757aacd
Make all the toolbuttons highlight on hover.
2023-05-31 21:07:14 -04:00
Adam Treat
93a05c8834
Fixup the plus new chat button.
2023-05-31 20:42:00 -04:00
Adam Treat
ae51e3f6fa
Use the proper text color for sending messages.
2023-05-31 20:31:59 -04:00
Adam Treat
95244a4d78
Fix warning.
2023-05-31 20:09:05 -04:00
Adam Treat
220e5547db
Draw the indicator for combobox to ensure it looks the same on all platforms.
2023-05-31 19:55:16 -04:00
Adam Treat
1370995b92
Add a custom busy indicator to further align look and feel across platforms.
2023-05-31 19:28:09 -04:00
AT
48275d0dcc
Dlopen backend 5 ( #779 )
...
Major change to the backend that allows for pluggable versions of llama.cpp/ggml. This was squashed merged from dlopen_backend_5 where the history is preserved.
2023-05-31 17:04:01 -04:00
Adam Treat
f4a1f7340c
Fix offset of prompt/response icons for smaller text.
2023-05-31 14:26:59 -04:00
Adam Treat
5f940208e4
Make the comboboxes align in UI.
2023-05-30 21:11:04 -04:00
Adam Treat
64ec93d59b
Some color and theme enhancements to make the UI contrast a bit better.
2023-05-30 21:03:40 -04:00
Adam Treat
e756675d56
Fix wording of this accessible description.
2023-05-30 20:01:12 -04:00
Adam Treat
3e828e1e4b
Add a hover and pressed to the visual indication of MyButton.
2023-05-30 19:58:37 -04:00
Adam Treat
122b14d526
Use the new MyButton for the regenerate response button.
2023-05-30 19:10:38 -04:00
Adam Treat
7aed367c68
Add a label to the model loading visual indicator.
2023-05-30 18:24:26 -04:00
Adam Treat
912cb2a842
Get rid of blocking behavior for regenerate response.
2023-05-30 18:17:59 -04:00
FoivosC
337c7fecac
construct and return the correct reponse when the request is a chat completion
2023-05-30 16:34:23 -04:00
Adam Treat
d9f5626481
Fix remove model from model download for regular models.
2023-05-30 16:16:09 -04:00
Adam Treat
810a3b12cc
This time remember to bump the version right after a release.
2023-05-25 18:26:33 -04:00
Adam Treat
d1ff7132c5
Bump the version number.
2023-05-25 17:08:50 -04:00
Adam Treat
afe3870b7a
Libraries named differently on msvc.
2023-05-25 16:27:09 -04:00
Adam Treat
474c5387f9
Get the backend as well as the client building/working with msvc.
2023-05-25 15:22:45 -04:00
Adam Treat
265488e54a
Add a newline
2023-05-25 11:28:06 -04:00
Adam Treat
98201540a2
Various fixes to remove unnecessary warnings.
2023-05-25 11:28:06 -04:00
Adam Treat
0403a122ca
Don't use the full path in reference text.
2023-05-25 11:28:06 -04:00
Adam Treat
9b0629db8b
Add context link to references.
2023-05-25 11:28:06 -04:00
Adam Treat
db9eecdce4
Store the references separately so they are not sent to datalake.
2023-05-25 11:28:06 -04:00
Adam Treat
b5380c9b7f
Adds the collections to serialize and implement references for localdocs.
2023-05-25 11:28:06 -04:00
Adam Treat
d81302950e
Complete the settings for localdocs.
2023-05-25 11:28:06 -04:00
Adam Treat
01b8c7617f
Add more of the UI for selecting collections for chats.
2023-05-25 11:28:06 -04:00
Adam Treat
2827c5876c
Clean up the settings dialog for localdocs a bit.
2023-05-25 11:28:06 -04:00
Adam Treat
d555ed3b07
Begin implementing the localdocs ui in earnest.
2023-05-25 11:28:06 -04:00
Adam Treat
120fbbf67d
Start fleshing out the localdocs ui.
2023-05-25 11:28:06 -04:00
Adam Treat
af33be7b3e
Add a localdocs tab.
2023-05-25 11:28:06 -04:00
Adam Treat
d9eddbec45
Add a collection list to support a UI.
2023-05-25 11:28:06 -04:00
Adam Treat
68ba9c564b
Specify a large number of suffixes we will search for now.
2023-05-25 11:28:06 -04:00
Adam Treat
c800291e7f
Add prompt processing and localdocs to the busy indicator in UI.
2023-05-25 11:28:06 -04:00
Adam Treat
618895f0a1
Turn off the debugging messages by default.
2023-05-25 11:28:06 -04:00
Adam Treat
c6df4645c8
Add a new muted text color.
2023-05-25 11:28:06 -04:00
Adam Treat
54fc980cb5
Cleanup of the database, better chunking, better matching.
2023-05-25 11:28:06 -04:00
Adam Treat
5f533e76a1
Remove this signal as unnecessary for now.
2023-05-25 11:28:06 -04:00
Adam Treat
e70a1c458b
Add remove folder implementation.
2023-05-25 11:28:06 -04:00
Adam Treat
d88eddbc20
Fixup the rescan. Fix debug output.
2023-05-25 11:28:06 -04:00
Adam Treat
7e42af5f33
localdocs
2023-05-25 11:28:06 -04:00
Adam Treat
b36a520207
Fix the build.
2023-05-23 18:20:17 -04:00
Adam Treat
bcce93555a
Small cleanups for settings dialog.
2023-05-23 14:53:01 -04:00
Justin Wang
5305bce59a
fix typo so padding can be accessed
2023-05-23 13:57:51 -04:00
Justin Wang
d7ab4c0e2d
change accessible description for thumbs up button
2023-05-23 12:15:54 -04:00
Justin Wang
a19ef751dc
add missing accessible props for buttons, remove forgotten duplicate accessible props
2023-05-23 12:15:54 -04:00
Justin Wang
e3d6eb334b
dedup qml: move accessible properties to MyButton
2023-05-23 12:15:54 -04:00
Justin Wang
eb6a7cca47
dedup qml: convert more buttons to MyButton
2023-05-23 11:03:32 -04:00
Adam Treat
8e705d730d
Minor tweaks to look and feel for some dialogs and button.
2023-05-22 22:20:16 -04:00
Justin Wang
2ce22208a3
deduplicate qml: create and use MyCheckBox and MyTextField
2023-05-22 18:03:13 -04:00
Justin Wang
15b3e0d3f6
remove padding
2023-05-22 17:22:05 -04:00
Justin Wang
28b0455451
replace buttons with MyButton
2023-05-22 17:22:05 -04:00
Adam Treat
5c1cf69b8b
Start to deduplicate code in qml.
2023-05-22 14:25:43 -04:00
Adam Treat
cfb45274e0
Fix the tabs so they don't have a double border on the bottom.
2023-05-22 09:04:37 -04:00
Adam Treat
d9698436df
Fix the dialog so it opens on the correct folder.
2023-05-22 09:04:25 -04:00
Juuso Alasuutari
81fdc28e58
llmodel: constify LLModel::threadCount()
2023-05-22 08:54:46 -04:00
Andriy Mulyar
914519e772
Update build_and_run.md ( #636 )
...
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-05-18 21:40:17 -04:00
Shukri
bce2b3025b
Fix typo in README
2023-05-17 09:56:20 -04:00
Adam Treat
a86a1aea6b
Fix for windows/mac installers.
2023-05-16 13:06:42 -04:00
Adam Treat
7221169eff
Remove davinci-003 option.
2023-05-16 13:06:42 -04:00
Adam Treat
86b6d40d08
Bump the version.
2023-05-16 13:06:42 -04:00
Yaroslav Halchenko
e4bc9c0c3b
fix ambigous typo
2023-05-16 11:33:59 -04:00
Adam Treat
79d6243fe1
Use the default for max_tokens to avoid errors.
2023-05-16 10:31:55 -04:00
Adam Treat
b24ace372b
Add ability to remove models.
2023-05-16 10:31:55 -04:00
Adam Treat
47059ad9f1
Send the prompt template with conversations to the datalake.
2023-05-16 10:31:55 -04:00
Adam Treat
748e7977ca
Generate the new prompt/response pair before model loading in server mode.
2023-05-16 10:31:55 -04:00
Adam Treat
f931de21c5
Add save/restore to chatgpt chats and allow serialize/deseralize from disk.
2023-05-16 10:31:55 -04:00
Adam Treat
0cd509d530
Add large network icon background for chatgpt and server modes.
2023-05-16 10:31:55 -04:00
Adam Treat
dd27c10f54
Preliminary support for chatgpt models.
2023-05-16 10:31:55 -04:00
Adam Treat
da3828af89
Use compact json format.
2023-05-16 10:31:55 -04:00
Adam Treat
b71c0ac3bd
The server has different lifetime mgmt than the other chats.
2023-05-13 19:34:54 -04:00
Adam Treat
ddc24acf33
Much better memory mgmt for multi-threaded model loading/unloading.
2023-05-13 19:10:56 -04:00
Adam Treat
2989b74d43
httpserver
2023-05-13 19:07:06 -04:00
Adam Treat
76675536b0
Cleanup the chatllm properly.
2023-05-12 17:11:52 -04:00
Adam Treat
4a2e3e55ae
Fix typo.
2023-05-11 16:48:20 -04:00
AT
2c5e2bf1ee
Update README.md
2023-05-11 15:31:01 -04:00
AT
507a96b2f3
Update README.md
2023-05-10 12:10:33 -04:00
Adam Treat
d918b02c29
Move the llmodel C API to new top-level directory and version it.
2023-05-10 11:46:40 -04:00
Adam Treat
6015154bef
Moving everything to subdir for monorepo merge.
2023-05-10 10:26:55 -04:00