AI/gpt4all
1
0
Fork 0
mirror of https://github.com/nomic-ai/gpt4all.git synced 2024-10-01 01:06:10 -04:00
Code Issues Packages Projects Releases Wiki Activity
2,096 Commits 491 Branches 56 Tags 46 MiB
448da045bc
Commit Graph

749 Commits

Author SHA1 Message Date
Jared Van Bortel
67fd391c8f
chat: fix documentation links (#2506) 
Now that the documentation has been overhauled, we need to point to the
new locations.

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-07-01 18:10:19 -04:00
John W. Parent
c0d311bc66
Add initial template windows signing flow (#2443) 
Adds workflow signing Windows installers with
EV certificate from Azure Key Vault via
AzureSignTool

Adds CMake to sign Windows binaries as they're processed

Installs dotnet 8 as required by AST

Signed-off-by: John Parent <john.parent@kitware.com>
 2024-07-01 17:40:02 -04:00
Adam Treat
576e167146 Bump the version to v3.0.0 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-07-01 16:50:28 -04:00
Jared Van Bortel
ce6680f046
chat: remove alt_logo.svg, tweak You/GPT4All icons (#2503) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-07-01 16:46:03 -04:00
AT
ff207dc344
Fix the erase search button to use the new icon. (#2501) 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-07-01 14:01:11 -04:00
Adam Treat
146428fa0a Bump version to rc5. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-07-01 08:01:57 -04:00
AT
fefc1f19c7
This is unnecessary and was a mistake to include. (#2496) 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-07-01 07:58:37 -04:00
Adam Treat
85fa4436f7 Change the wording slightly 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-30 23:49:05 -04:00
Adam Treat
357825232f Add a new transparent version of our icon and display it on homepage. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-30 23:47:34 -04:00
Adam Treat
f3d6c09d5a Remove the link as it does not work yet. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-30 23:38:52 -04:00
Adam Treat
534e772914 Test update of the latest news. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-30 23:36:54 -04:00
AT
36e5803893
This bottom padding while doing text generation is no longer necessary with the tray. (#2495) 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-30 23:27:30 -04:00
AT
56834a28cb
Fix response generation which was broken by themeable syntax highlighting. (#2494) 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-30 20:55:42 -04:00
cosmic-snow
ab46bd5739
Add documentation link to HomeView.qml (#2486) 
Additionally link to the documentation at https://docs.gpt4all.io/gpt4all_chat.html

Signed-off-by: cosmic-snow <134004613+cosmic-snow@users.noreply.github.com>
 2024-06-30 19:35:31 -04:00
AT
ef6f0dd421
Fix for reload button hovering and size of combobox if model with large name is selected. (#2493) 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-30 19:26:53 -04:00
AT
37dbd56153
Latest rc5 fixes (#2492) 
* Adjust the size of the new conversation tray to enlarge a bit.

* Add themeable code syntax highlighting.

* Change the default size to a larger context chunk for localdocs.

Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-30 19:15:01 -04:00
AT
4a1a3c48e8
Latest v3.0.0 rc4 fixes (#2490) 
* Use the same font size for code blocks as we do for the rest of the chat text.

* Add a conversation tray after discussion with Vincent and Andriy and gathering
of feedback from some other users. This adds the reset context back as a
recycle button and copy chat features back to the app for v3.0.0.

Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-30 15:10:19 -04:00
Adam Treat
1bc16a2a4f Bump version to v3.0.0-rc4 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-29 18:02:45 -04:00
AT
b5fdc4c05a
Chatview and combobox UI fixes (#2489) 
Chatview and combobox UI fixes (#2489)

Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-29 18:00:52 -04:00
AT
55858f93b0
Solve a bad performance problem in text processing that leads to hangs of the UI. (#2487) 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-29 17:59:45 -04:00
Adam Treat
720ea5a147 Bump the version to rc3. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-28 20:34:17 -04:00
Jared Van Bortel
a191844a3f
new UI fixes, part 5 (#2485) 
additional new ui changes, part 5 (#2485)

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-06-28 20:34:03 -04:00
Jared Van Bortel
22396a6fa1
AddCollectionView: fix label colors (#2484) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-06-28 17:50:12 -04:00
Jared Van Bortel
f2cad6abaa
additional new ui changes, part 4 (#2481) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-06-28 17:11:12 -04:00
Adam Treat
d893a6e5d6 Give it an empty string default. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-28 14:52:44 -04:00
Adam Treat
8fe73832a6 Fix up the loading default model to display the actual name as per Vincent. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-28 14:52:44 -04:00
John W. Parent
23e8b187a4
Add basic signing of app bundle and binaries (#2472) 
Adds verification functionality to codesign script
Adds required context to enable XCode to perform the signing
Adds install time check + signing for all binaries
Adds instructions allowing macdeployqt to sign the finalized app bundle

Signed-off-by: John Parent <john.parent@kitware.com>
 2024-06-28 14:21:18 -04:00
AT
dc6d01a0bb
Change the name of this property to not conflict. (#2480) 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-28 13:34:26 -04:00
Jared Van Bortel
2c8d634b5b
UI and embedding device changes for GPT4All v3.0.0-rc3 (#2477) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-06-28 12:57:57 -04:00
AT
426aa5eb47
Go ahead and try to handle links in the text by opening them externally. (#2479) 
Handle links in the text by opening them externally.

Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-28 12:54:12 -04:00
Jared Van Bortel
81bbeef5b3 partially back out that change, I wasn't reading 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-06-28 11:49:12 -04:00
Jared Van Bortel
1712830228 chatviewtextprocessor: fix missing #include and simplify sort 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-06-28 11:49:12 -04:00
Adam Treat
f6f265f968 This allows support for markdown table display and <foo> 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-28 11:49:12 -04:00
Adam Treat
6f52f602ef Improved markdown support: 
* Correctly displays inline code blocks with syntax highlighting turned on
as well as markdown at the same time
* Adds a context menu item for toggling markdown on and off which also
which essentially turns on/off all text processing
* Uses QTextDocument::MarkdownNoHTML to handle markdown in QTextDocument
which allows display of html tags like normal, but unfortunately does not
allow display of markdown tables as markdown

Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-28 11:49:12 -04:00
Adam Treat
d92252cab1 Revert an incorrect renaming that slipped in. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-27 11:14:12 -04:00
Jared Van Bortel
6506ba161b
UI tweaks for GPT4All v3.0.0-rc2 (#2474) 
* clickable link to get API key with hand-style mouse cursor
* remove "Force Metal" setting
* allow typing incorrect API keys (but don't accept them), add placeholder text

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-06-27 11:08:32 -04:00
Adam Treat
bed92046d0 Set the 3.0.0-rc2 version. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-27 11:00:00 -04:00
Adam Treat
a1ec6f2150 Change the divider height and color to be more consistent. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-27 07:25:39 -04:00
Adam Treat
8d6e11fcad Change to just sources after multiple feedback advising same. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-27 07:25:39 -04:00
Adam Treat
fc5dc9dd1a Fix the scrollbar so it doesn't overlap content on chat view. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-27 07:25:39 -04:00
Adam Treat
d4494602e2 Markdown support. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-27 07:25:39 -04:00
AT
23e8f43c5a
Change the way we're showing the localdocs sources. (#2475) 
* Change the way we're showing the localdocs sources.

Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-26 22:00:48 -04:00
Adam Treat
31fa575c35 Place the antenna icon in the lower left right above nomic logo as per discussion. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-26 16:43:22 -04:00
Adam Treat
6d593d6ea1 Fix the thumbsdown dialog. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-26 16:37:01 -04:00
Jared Van Bortel
01870b4a46
chat: fix blank device in UI and improve Mixpanel reporting (#2409) 
Also remove LLModel::hasGPUDevice.

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-06-26 15:26:27 -04:00
Adam Treat
53fc2d56f6 Add a tooltip to make clear what is going on with the antenna animation. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-26 15:20:09 -04:00
Adam Treat
e5d9936d04 Update the license. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-26 15:07:51 -04:00
Adam Treat
11823022e2 Add a fixme for combobox popups in general which is less than ideal right now. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-26 15:00:50 -04:00
AT
3a61070f82
chat: fix incorrect file URIs for sources on Windows (#2469) 
This was causing LocalDocs sources to not open correctly on Windows.

Signed-off-by: Adam Treat <treat.adam@gmail.com>
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
Co-authored-by: Jared Van Bortel <jared@nomic.ai>
 2024-06-26 14:48:02 -04:00
Adam Treat
c87ccf4124 Make the chatview combo scrollable. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-26 14:39:39 -04:00
Adam Treat
88f5face2b Change section headers to be lighter and smaller as per Vincent. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-26 13:48:02 -04:00
Adam Treat
f8a935d8a6 Decrease vertical size of search bar and spacing in add model view. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-26 13:00:01 -04:00
Adam Treat
029bd318e9 If huggingface search doesn't give this information, then display question mark. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-26 12:31:11 -04:00
Adam Treat
d5968f4ab2 Make the chatdrawer edit/delete icons smaller. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-26 12:19:02 -04:00
Jared Van Bortel
88d85be0f9
chat: fix build on Windows and Nomic Embed path on macOS (#2467) 
* chat: remove unused oscompat source files

These files are no longer needed now that the hnswlib index is gone.
This fixes an issue with the Windows build as there was a compilation
error in oscompat.cpp.

Signed-off-by: Jared Van Bortel <jared@nomic.ai>

* llm: fix pragma to be recognized by MSVC

Replaces this MSVC warning:
C:\msys64\home\Jared\gpt4all\gpt4all-chat\llm.cpp(53,21): warning C4081: expected '('; found 'string'

With this:
C:\msys64\home\Jared\gpt4all\gpt4all-chat\llm.cpp : warning : offline installer build will not check for updates!

Signed-off-by: Jared Van Bortel <jared@nomic.ai>

* usearch: fork usearch to fix `CreateFile` build error

Signed-off-by: Jared Van Bortel <jared@nomic.ai>

* dlhandle: fix incorrect assertion on Windows

SetErrorMode returns the previous value of the error mode flags, not an
indicator of success.

Signed-off-by: Jared Van Bortel <jared@nomic.ai>

* llamamodel: fix UB in LLamaModel::embedInternal

It is undefined behavior to increment an STL iterator past the end of
the container. Use offsets to do the math instead.

Signed-off-by: Jared Van Bortel <jared@nomic.ai>

* cmake: install embedding model to bundle's Resources dir on macOS

Signed-off-by: Jared Van Bortel <jared@nomic.ai>

* ci: fix macOS build by explicitly installing Rosetta

Signed-off-by: Jared Van Bortel <jared@nomic.ai>

---------

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-06-25 17:22:51 -04:00
AT
bbf0c2f246
Update qa_checklist.md 
Add the directories for each OS

Signed-off-by: AT <manyoso@users.noreply.github.com>
 2024-06-25 13:50:19 -04:00
AT
9363ffb958
Update qa_checklist.md 
Add another step for users to shutdown and retest with settings and so on from a previous version

Signed-off-by: AT <manyoso@users.noreply.github.com>
 2024-06-25 13:15:29 -04:00
AT
8724572d61
Create qa_checklist.md 
Add a checklist for QA testing

Signed-off-by: AT <manyoso@users.noreply.github.com>
 2024-06-25 13:06:52 -04:00
Jared Van Bortel
1a00882276
embllm: fix use of llama ctx before loading (#2465) 
This fixes a regression in PR #2396.

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-06-25 11:04:01 -04:00
AT
9273b49b62
chat: major UI redesign for v3.0.0 (#2396) 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
Co-authored-by: Jared Van Bortel <jared@nomic.ai>
 2024-06-24 18:49:23 -04:00
Adam Treat
1272b694ae Add a latest news markdown file for future version. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-06-24 13:57:12 -04:00
Jared Van Bortel
41c9013fa4
chat: don't use incomplete types with signals/slots/Q_INVOKABLE (#2408) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-06-06 11:59:28 -04:00
Jared Van Bortel
d3d777bc51
chat: fix #includes with include-what-you-use (#2401) 
Also use qGuiApp instead of qApp.

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-06-04 14:47:11 -04:00
Jared Van Bortel
f1b4092ca6
llamamodel: fix BERT tokenization after llama.cpp update (#2381) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-05-28 13:11:57 -04:00
Jared Van Bortel
0b63ad5eff
chat: add release notes for v2.8.0 and bump version (#2372) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-05-23 10:29:25 -04:00
Jared Van Bortel
e021fe130f
installer script: fix detection of macOS on newer QtIFW (#2361) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-05-17 12:28:46 -04:00
Jared Van Bortel
a92d266cea
cmake: fix Metal build after #2310 (#2350) 
I don't understand why this is needed, but it works.

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-05-15 18:12:32 -04:00
Jared Van Bortel
d2a99d9bc6
support the llama.cpp CUDA backend (#2310) 
* rebase onto llama.cpp commit ggerganov/llama.cpp@d46dbc76f
* support for CUDA backend (enabled by default)
* partial support for Occam's Vulkan backend (disabled by default)
* partial support for HIP/ROCm backend (disabled by default)
* sync llama.cpp.cmake with upstream llama.cpp CMakeLists.txt
* changes to GPT4All backend, bindings, and chat UI to handle choice of llama.cpp backend (Kompute or CUDA)
* ship CUDA runtime with installed version
* make device selection in the UI on macOS actually do something
* model whitelist: remove dbrx, mamba, persimmon, plamo; add internlm and starcoder2

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-05-15 15:27:50 -04:00
Jared Van Bortel
fbbf810020
chat: fix issues with the initial "New Chat" (#2330) 
* select the existing new chat if there already is one when "New Chat" is clicked
* scroll to the new chat when "New Chat" is clicked
* fix the "New Chat" being scrolled past the top of the chat list

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-05-15 14:09:32 -04:00
Jared Van Bortel
7e1e00f331
chat: fix issues with quickly switching between multiple chats (#2343) 
* prevent load progress from getting out of sync with the current chat
* fix memory leak on exit if the LLModelStore contains a model
* do not report cancellation as a failure in console/Mixpanel
* show "waiting for model" separately from "switching context" in UI
* do not show lower "reload" button on error
* skip context switch if unload is pending
* skip unnecessary calls to LLModel::saveState

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-05-15 14:07:03 -04:00
Jared Van Bortel
7f1c3d4275
chatllm: fix model loading progress showing "Reload" sometimes (#2337) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-05-15 13:57:53 -04:00
AT
61cefcfd8a
Fix destruction and tear down of the embedding thread. (#2328) 
* Fix destruction and tear down of the embedding thread.

Signed-off-by: Adam Treat <treat.adam@gmail.com>

* Fix order of deletion to prevent use after free.

Signed-off-by: Adam Treat <treat.adam@gmail.com>

---------

Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-05-15 10:01:53 -04:00
Jared Van Bortel
1427ef7195
chat: fix window icon on Windows (#2321) 
* chat: fix window icon on Windows

Signed-off-by: Jared Van Bortel <jared@nomic.ai>

* chat: remove redundant copy of macOS app icon

This has been redundant since PR #2180.

Signed-off-by: Jared Van Bortel <jared@nomic.ai>

---------

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-05-09 13:42:46 -04:00
Tim453
69720fedaa
Update appdata.xml (#2307) 2024-05-09 12:51:38 -04:00
Jared Van Bortel
5fb9d17c00
chatllm: use a better prompt for the generated chat name (#2322) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-05-09 09:38:19 -04:00
Jared Van Bortel
f26e8d0d87
chat: do not allow sending a message while the LLM is responding (#2323) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-05-09 09:37:36 -04:00
Jared Van Bortel
d54e644d05
ChatView: make context menus more intuitive (#2324) 
* ChatView: fix deprecation warning

Signed-off-by: Jared Van Bortel <jared@nomic.ai>

* ChatView: make context menus more intuitive

Signed-off-by: Jared Van Bortel <jared@nomic.ai>

---------

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-05-09 09:35:54 -04:00
Jared Van Bortel
26eaf598b4
chat: add release notes for v2.7.5 and bump version (#2300) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-05-03 09:54:09 -04:00
Jared Van Bortel
577ebd4826
mixpanel: report cpu_supports_avx2 on startup (#2299) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-05-02 16:09:41 -04:00
Jared Van Bortel
855fd22417
localdocs: load model before checking which model is loaded (#2284) 
* localdocs: load model before checking what we loaded

Fixes "WARNING: Request to generate sync embeddings for non-local model
invalid"

Signed-off-by: Jared Van Bortel <jared@nomic.ai>

* fix inverted assertion

Signed-off-by: Jared Van Bortel <jared@nomic.ai>

---------

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-05-02 09:30:36 -04:00
Jared Van Bortel
adaecb7a72
mixpanel: improved GPU device statistics (plus GPU sort order fix) (#2297) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-05-01 16:15:48 -04:00
Jared Van Bortel
27c561aeb7
mixpanel: fix opt-out events after #2238 (#2296) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-05-01 12:08:40 -04:00
Jared Van Bortel
6f38fde80b
mixpanel: fix doc_collections_total of localdocs_startup (#2270) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-04-26 14:05:47 -04:00
Jared Van Bortel
a14193623a
chat: add release notes for v2.7.4 and bump version (#2269) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-04-26 12:55:54 -04:00
Jared Van Bortel
4f3c9bbe3e
network: fix use of GNU asm statement with MSVC (#2267) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-04-26 11:22:24 -04:00
Jared Van Bortel
c622921894
improve mixpanel usage statistics (#2238) 
Other changes:
- Always display first start dialog if privacy options are unset (e.g. if the user closed GPT4All without selecting them)
- LocalDocs scanQueue is now always deferred
- Fix a potential crash in magic_match
- LocalDocs indexing is now started after the first start dialog is dismissed so usage stats are included

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-04-25 13:16:52 -04:00
Jared Van Bortel
4193533154
models.json: add Phi-3 Mini Instruct (#2252) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-04-23 18:53:09 -04:00
Jared Van Bortel
0b78b79b1c
models.json: add Llama 3 Instruct 8B (#2242) 
Other changes:
* fix 'requires' for models with %2 in template
* move Ghost 7B to the appropriate location in the file based on where it actually appears in the UI

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-04-19 13:09:44 -04:00
Jared Van Bortel
aac00d019a
chat: temporarily revert some UI changes before next release (#2234) 
* chat: revert PR #2187

Signed-off-by: Jared Van Bortel <jared@nomic.ai>

* chat: revert PR #2148

This reverts commit f571e7e450.

Signed-off-by: Jared Van Bortel <jared@nomic.ai>

---------

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-04-18 14:52:29 -04:00
Jared Van Bortel
271d752701
localdocs: small but important fixes to local docs (#2236) 
* chat: use .rmodel extension for Nomic Embed

Signed-off-by: Jared Van Bortel <jared@nomic.ai>

* database: fix order of SQL arguments in updateDocument

Signed-off-by: Jared Van Bortel <jared@nomic.ai>

---------

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-04-18 14:51:13 -04:00
Jared Van Bortel
be93ee75de
responsetext : fix markdown code block trimming (#2232) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-04-18 14:50:32 -04:00
Jared Van Bortel
38cc778a0c
models.json: use simpler system prompt for Mistral OpenOrca (#2220) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-04-15 18:02:51 -04:00
Adam Treat
94a9943782 Change the behavior of show references setting for localdocs. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-04-15 14:30:26 -05:00
Adam Treat
e27653219b Fix bugs with the context link text for localdocs to make the context links 
persistently work across application loads and fix scrolling bug with context
links.

Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-04-15 14:30:26 -05:00
Jared Van Bortel
ac498f79ac
fix regressions in system prompt handling (#2219) 
* python: fix system prompt being ignored
* fix unintended whitespace after system prompt

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-04-15 11:39:48 -04:00
Adam Treat
790320e170 Use consistent names for LocalDocs 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-04-03 08:02:52 -05:00
Adam Treat
aad502f336 Rename these to views. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-04-03 08:02:52 -05:00
Adam Treat
77d5adfb02 Changes to the UI and icons. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-04-03 08:02:52 -05:00
3Simplex
9c23d44ad3 Update ChatView.qml 
Directed the Documentation link specifically to the ChatUI documentation.


Co-authored-by: ThiloteE <73715071+ThiloteE@users.noreply.github.com>

Signed-off-by: 3Simplex <10260755+3Simplex@users.noreply.github.com>
 2024-04-01 08:34:49 -05:00
3Simplex
4f6c43aec9 Update ChatView.qml 
Include links for Documentation and FAQ for new users on the "new chat view".


Co-authored-by: ThiloteE <73715071+ThiloteE@users.noreply.github.com>

Signed-off-by: 3Simplex <10260755+3Simplex@users.noreply.github.com>
 2024-04-01 08:34:49 -05:00
Robin Verduijn
4852d39699 Fix to set proper app icon on MacOS. 
Signed-off-by: Robin Verduijn <robinverduijn.github@gmail.com>
 2024-04-01 08:34:02 -05:00
Adam Treat
b4bcc5b37c Fix colors for server chat in all themes. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-20 15:10:26 -05:00
Adam Treat
f571e7e450 Preliminary redesign of the UI. This has no major regression. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-20 11:45:26 -05:00
Lam Hieu
271e6a529c Rename the model for more clarity 
Signed-off-by: Lam Hieu <lamhieu.vk@gmail.com>
 2024-03-20 10:16:25 -05:00
Lam Hieu
5732928b93 Change download url 
Signed-off-by: Lam Hieu <lamhieu.vk@gmail.com>
 2024-03-20 10:16:25 -05:00
Lam Hieu
6a22b81f44 Update Ghost 7B v0.9.1 configuration 
Signed-off-by: Lam Hieu <lamhieu.vk@gmail.com>
 2024-03-20 10:16:25 -05:00
Lam Hieu
f50bf856b3 Fix invalid model configuration 
Signed-off-by: Lam Hieu <lamhieu.vk@gmail.com>
 2024-03-20 10:16:25 -05:00
Lam Hieu
df79e45195 Support Ghost 7B v0.9.1, fast, powerful and smooth for Vietnamese and English languages. 
Signed-off-by: Lam Hieu <lamhieu.vk@gmail.com>
 2024-03-20 10:16:25 -05:00
Jared Van Bortel
699410014a
fix non-AVX CPU detection (#2141) 
* chat: fix non-AVX CPU detection on Windows
* bindings: throw exception instead of logging to console

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-03-19 10:56:14 -04:00
Tim453
6c2542e540 Allow changing the install path 
This commit allow changing the install path during CMake configure step using the CMAKE_INSTALL_PREFIX variable. If the variable is not set, it still defaults to {CMAKE_BINARY_DIR}/install.

Signed-off-by: Tim453 <50015765+Tim453@users.noreply.github.com>
 2024-03-18 11:57:56 -05:00
Jared Van Bortel
255568fb9a
python: various fixes for GPT4All and Embed4All (#2130) 
Key changes:
* honor empty system prompt argument
* current_chat_session is now read-only and defaults to None
* deprecate fallback prompt template for unknown models
* fix mistakes from #2086

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-03-15 11:49:58 -04:00
Adam Treat
667f29c2a1 Split the main.qml into two pieces to support multiple views in future. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-14 09:42:23 -05:00
Adam Treat
97de30edd1 Fix bug with removing old .txt chatgpt files in favor of .rmodel 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-13 17:37:18 -05:00
Olyxz16
2c0a660e6e
feat: Add support for Mistral API models (#2053) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
Signed-off-by: Cédric Sazos <cedric.sazos@tutanota.com>
Co-authored-by: Jared Van Bortel <jared@nomic.ai>
 2024-03-13 18:23:57 -04:00
Jared Van Bortel
406e88b59a
implement local Nomic Embed via llama.cpp (#2086) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-03-13 18:09:24 -04:00
Adam Treat
171f4e488e Restrict the chat view text width to a reasonable maximum. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-13 17:01:19 -05:00
Adam Treat
6adaa672b4 Default to expanded state. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-13 14:23:04 -05:00
Adam Treat
b68ebb7c15 Rework the left chat panel to be persistently open. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-13 14:23:04 -05:00
Xu Zhen
0072860d24 Fix compatibility with Qt 6.4 
Signed-off-by: Xu Zhen <xuzhen@users.noreply.github.com>
 2024-03-12 07:42:22 -05:00
Adam Treat
ef9717dbe9 Use translation function for newly introduced strings. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-11 20:39:34 -04:00
Kryotek
afbb30a523 Add context menus to the prompt and the responses 
Signed-off-by: Kryotek <gcda@outlook.it>
 2024-03-11 19:36:18 -05:00
Adam Treat
11db71e0a7 Bump version and release notes for v2.7.3 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-11 14:44:14 -04:00
Adam Treat
5ed9aea410 Don't clear installed models. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-11 14:08:40 -04:00
Adam Treat
e2f64f89c9 When the current chat has no model use the first index. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-11 14:00:51 -04:00
Adam Treat
0daf37ab8a Fixes issue #2105 by using the original url for the download. This fix is 
valid because we expect the url to contain the actual filename at the end.
This also allows huggingface to track the download as happening.

Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-11 12:54:39 -05:00
Adam Treat
a6a3e0048a Don't erase the settings, but ignore them. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-11 12:52:23 -05:00
Adam Treat
f36a2874eb Clean up settings properly for removed models and also when user manually deletes. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-11 12:52:23 -05:00
chrisbarrera
61d6765361 #2024 Update ModelSettings.qml to default model/char settings combobox to the currently selected chat model 
Signed-off-by: chrisbarrera <34655880+chrisbarrera@users.noreply.github.com>
 2024-03-10 09:26:38 -05:00
Adam Treat
59f99b7f21 Minor fixes to server port feature. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-09 10:32:53 -05:00
Daniel Alencar
fe653d1489 feat: added api server port setting 2024-03-09 09:26:40 -06:00
Jared Van Bortel
5c248dbec9
models: new MPT model file without duplicated token_embd.weight (#2006) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-03-08 17:18:38 -05:00
Adam Treat
6ed3d01f17 Fix issue #2087 where cloned models were lost and listed in download dialog erroneously. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-08 15:55:16 -06:00
Adam Treat
6c3903a303 Fixes issue #2092. Don't include disabled from GUI models in application 
default model list.

Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-08 11:21:38 -06:00
Adam Treat
8ee68d1b6f Increase indent for readability. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-08 10:31:09 -06:00
Adam Treat
4251b7beaa Fix issue #2077 part 2. Only sort when actually necessary. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-08 10:31:09 -06:00
Adam Treat
fc169e739a Add trailing commas for things that need to be added in the future. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-08 09:44:20 -06:00
Adam Treat
028a8db6ba No need to use equals here. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-08 09:44:20 -06:00
Adam Treat
26cedb83b0 Use initializer lists instead of append where applicable. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-08 09:44:20 -06:00
Adam Treat
9c755d25c4 Get rid of unnecessary qMakePair 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-08 09:44:20 -06:00
Adam Treat
099459c8b9 Update batch patch following review. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-08 09:44:20 -06:00
AT
8474d76fec Update gpt4all-chat/download.cpp 
Co-authored-by: Jared Van Bortel <jared@nomic.ai>
Signed-off-by: AT <manyoso@users.noreply.github.com>
 2024-03-08 09:44:20 -06:00
Adam Treat
08b5dc8598 Batch all operations for updateData to avoid excessive sort. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-08 09:44:20 -06:00
Adam Treat
17dee02287 Fix for issue #2080 where the GUI appears to hang when a chat with a large 
model is deleted. There is no reason to save the context for a chat that
is being deleted.

Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-06 16:52:17 -06:00
Jared Van Bortel
44717682a7
chat: implement display of model loading warnings (#2034) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-03-06 17:14:54 -05:00
Jared Van Bortel
a0bd96f75d
chat: join ChatLLM threads without calling destructors (#2043) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-03-06 16:42:59 -05:00
Jared Van Bortel
5a874be7c1
modellist: rename "deprecated" to "removedIn", disable if equal (#2063) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-03-06 14:12:21 -05:00
Jared Van Bortel
402f515a5d
chat: fix ChatGPT after #1970 (#2051) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-03-06 14:02:18 -05:00
Jared Van Bortel
2a91ffd73f chatllm: fix undefined behavior in resetContext 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-03-06 12:54:19 -06:00
Jared Van Bortel
0fc071d228 chat: better handle case where network reachability is unknown 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-03-06 12:52:37 -06:00
Adam Treat
be6d3bf9dc Bump version and release notes for 2.7.2 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-05 13:15:21 -05:00
Adam Treat
83c76be68a Model discovery. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-03-05 11:31:47 -05:00
ThiloteE
f2b4809b72
models3: remove system prompt of Nous-Hermes-2-Mistral-7b-DPO (#2054) 
Signed-off-by: ThiloteE <73715071+ThiloteE@users.noreply.github.com>
Co-authored-by: Jared Van Bortel <cebtenzzre@gmail.com>
 2024-03-01 14:19:18 -05:00
Jared Van Bortel
9fafca5c94 qml: update models.json URL in error message 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-03-01 13:50:10 -05:00
Adam Treat
7d1e30766f Fix the hash on the new model. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-02-27 09:56:11 -05:00
Adam Treat
5ddcf61ae4 Shorten the description and provide a valid url. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-02-27 09:34:50 -05:00
ThiloteE
713afb7070 Add-Nous-Hermes-2-Mistral-7B-DPO.Q4_0.gguf 
Adds Nous-Hermes-2-Mistral-7B-DPO.Q4_0.gguf, which is the new 7b flagship model of NousResearch.

**Original Model location:**

https://huggingface.co/NousResearch/Nous-Hermes-2-Mistral-7B-DPO-GGUF

**Model description:**

Nous Hermes 2 on Mistral 7B DPO is the new flagship 7B Hermes! This model was DPO'd from Teknium/OpenHermes-2.5-Mistral-7B and has improved across the board on all benchmarks tested - AGIEval, BigBench Reasoning, GPT4All, and TruthfulQA.

The model prior to DPO was trained on 1,000,000 instructions/chats of GPT-4 quality or better, primarily synthetic data as well as other high quality datasets, available from the repository teknium/OpenHermes-2.5.

**Original Dataset Location:**

https://huggingface.co/datasets/teknium/OpenHermes-2.5

**Dataset description:**

This is the dataset that made OpenHermes 2.5 and Nous Hermes 2 series of models.

The Open Hermes 2/2.5 and Nous Hermes 2 models have made significant advancements of SOTA LLM's over recent months, and are underpinned by this exact compilation and curation of many open source datasets and custom created synthetic datasets.

The Open Hermes 2.5 dataset is a continuation of the Open Hermes 1 dataset, at a much larger scale, much more diverse, and much higher quality compilation, reaching 1M, primarily synthetically generated instruction and chat samples.



Signed-off-by: ThiloteE <73715071+ThiloteE@users.noreply.github.com>
 2024-02-27 08:28:43 -06:00
Jared Van Bortel
f500bcf6e5
llmodel: default to a blank line between reply and next prompt (#1996) 
Also make some related adjustments to the provided Alpaca-style prompt templates
and system prompts.

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-02-26 13:11:15 -05:00
Jared Van Bortel
fc1a281381
modellist: fix bad copy-paste in ModelList::clone (#2011) 
s/contextLength/gpuLayers/

Fixes #2010

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-02-26 13:09:29 -05:00
AT
7a23b23728 Update gpt4all-chat/modellist.cpp 
Co-authored-by: Jared Van Bortel <jared@nomic.ai>
Signed-off-by: AT <manyoso@users.noreply.github.com>
 2024-02-26 12:04:16 -06:00
Adam Treat
17a2cdbe35 Fix crasher with layer count 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-02-26 12:04:16 -06:00
chrisbarrera
f8b1069a1c
add min_p sampling parameter (#2014) 
Signed-off-by: Christopher Barrera <cb@arda.tx.rr.com>
Co-authored-by: Jared Van Bortel <cebtenzzre@gmail.com>
 2024-02-24 17:51:34 -05:00
Adam Treat
ef518fae3e Fix crash with chatgpt and gpu layers. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-02-22 15:51:56 -06:00
Jared Van Bortel
c1dcb3f5b8 models.json: fix Mistral OpenOrca filename 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-02-22 08:57:51 -06:00
Adam Treat
a010a8a7ca Bump version and release notes for v2.7.1 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-02-21 16:54:08 -05:00
Jared Van Bortel
ef0a67eb94
models: remove gemma from models2.json and models3.json (#1995) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-02-21 16:18:26 -05:00
Adam Treat
67bbce43ab Fix state issues with reloading model. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-02-21 16:05:49 -05:00
Jared Van Bortel
4fc4d94be4
fix chat-style prompt templates (#1970) 
Also use a new version of Mistral OpenOrca.

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-02-21 15:45:32 -05:00
Jared Van Bortel
b8f5c74f40
add models3.json for new templates (#1993) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-02-21 15:41:20 -05:00
Jared Van Bortel
c13202a6f5 models2.json: gemma requires a future GPT4All version 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-02-21 14:43:55 -05:00
Jared Van Bortel
4a8c6d7f9c gemma: fix default prompt template 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-02-21 13:36:31 -06:00
Jared Van Bortel
32837fb3a0 models2.json: add gemma model 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-02-21 13:36:31 -06:00
Adam Treat
896fc6fbb7 Save the window size for the user and reuse next load. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-02-21 11:54:26 -06:00
Adam Treat
fa0a2129dc Don't try and detect model load error on startup. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-02-21 10:15:20 -06:00
Adam Treat
b0c471aed8 Make the reload/regenerate buttons a little bit larger font. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-02-21 10:15:20 -06:00
Adam Treat
67099f80ba Add comment to make this clear. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-02-21 10:15:20 -06:00
Adam Treat
ad34c2bdd4 Don't erase context when reloading model by selection. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-02-21 10:15:20 -06:00
Adam Treat
fbf5e5e732 Increase padding for elided text in combo. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-02-21 10:15:20 -06:00
Adam Treat
ed0f93977d Fixes for issues identified in review. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-02-21 10:15:20 -06:00
Adam Treat
d948a4f2ee Complete revamp of model loading to allow for more discreet control by 
the user of the models loading behavior.

Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-02-21 10:15:20 -06:00
Adam Treat
16927d9a76 Fix visual artifact with close button in new version dialog. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-02-12 12:25:33 -05:00
Adam Treat
f569ae9b22 Bump version and release notes for v2.7.0 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-02-08 12:31:59 -05:00
Jared Van Bortel
2020c23edf
chat: set version to 2.7.0 (#1940) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-02-07 10:51:57 -05:00
Adam Treat
260a56c748 Don't show the download button if we are not connected to an online network. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-02-07 09:40:49 -06:00
Adam Treat
4258bb1f8a Fix issue 1918 for accessibility of screen readers. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-02-07 10:37:31 -05:00
Adam Treat
490404dbb2 Fix issue 1925, scrollbar missing on main conversation. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-02-07 10:08:35 -05:00
Jared Van Bortel
513a214eca database: limit supported extensions to txt, pdf, md, rst 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-02-07 08:56:25 -06:00
Jared Van Bortel
78a26cc5e4
models2.json: use ChatML for Mistral OpenOrca (#1935) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-02-06 12:43:10 -05:00
Adam Treat
1b524c4617 Reverse patch so we can minimize down to lowest HD form factor. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-02-06 09:59:26 -05:00
Adam Treat
cb10465127 Make the collection dialog progress bar more readable. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-02-06 09:35:07 -05:00
Adam Treat
4461af35c7 Fix includes. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-02-05 16:46:16 -05:00
Jared Van Bortel
10e3f7bbf5
Fix VRAM leak when model loading fails (#1901) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-02-01 15:45:45 -05:00
Adam Treat
e1eac00ee0 Fix the download and settings dialog to take more real estate if available on large monitors. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-02-01 15:43:34 -05:00
Adam Treat
111e152a5d Fix the sizing for model download. 
Signed-off-by: Adam Treat <adam@nomic.ai>
 2024-02-01 15:39:28 -05:00
Adam Treat
ffed2ff823 Fix for progress bar color on legacy theme. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-02-01 08:29:44 -05:00
Adam Treat
a5275ea9e7 Bump the version and release notes for v2.6.2. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-01-31 23:25:58 -05:00
Adam Treat
cdf0fedae2 Make sure to use the search_query tag for nomic embed. 
Signed-off-by: Adam Treat <treat.adam@gmail.com>
 2024-01-31 22:44:16 -05:00
Adam Treat
d14b95f4bd Add Nomic Embed model for atlas with localdocs. 2024-01-31 22:22:08 -05:00
Jared Van Bortel
0a40e71652
Maxwell/Pascal GPU support and crash fix (#1895) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-01-31 16:32:32 -05:00
Jared Van Bortel
061d1969f8
expose n_gpu_layers parameter of llama.cpp (#1890) 
Also dynamically limit the GPU layers and context length fields to the maximum supported by the model.

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-01-31 14:17:44 -05:00
Jared Van Bortel
29d2c936d1
chat: don't show "retrieving localdocs" for zero collections (#1874) 
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
 2024-01-29 13:57:42 -05:00