gpt4all/gpt4all-chat
Akarshan Biswas d686a583f9 Enable Wayland in build
# Describe your changes
The patch include support for running natively on a Linux Wayland display server/compositor which is successor to old Xorg.
Cmakelist was missing WaylandClient so added it back.

Will fix #1047 .

Signed-off-by: Akarshan Biswas <akarshan.biswas@gmail.com>
2023-06-26 14:58:23 -03:00
..
cmake Fix metal and replit. 2023-06-16 17:13:49 -04:00
icons Add more of the UI for selecting collections for chats. 2023-05-25 11:28:06 -04:00
metadata Minor models.json description corrections. (#1013) 2023-06-18 14:10:29 -04:00
qml Change "web server" to "API server" for less confusion (#1039) 2023-06-23 16:28:52 -04:00
build_and_run.md Update build_and_run.md (#834) 2023-06-04 15:39:32 -04:00
chat.cpp Get rid of last blocking operations and make the chat/llm thread safe. 2023-06-20 18:18:10 -03:00
chat.h Get rid of last blocking operations and make the chat/llm thread safe. 2023-06-20 18:18:10 -03:00
chatgpt.cpp llmodel: constify LLModel::threadCount() 2023-05-22 08:54:46 -04:00
chatgpt.h llmodel: change tokenToString to not use string_view (#968) 2023-06-13 07:14:02 -04:00
chatlistmodel.cpp Exit early when no chats are saved. 2023-06-20 18:30:17 -04:00
chatlistmodel.h Move saving chats to a thread and display what we're doing to the user. 2023-06-20 17:18:33 -04:00
chatllm.cpp Get rid of last blocking operations and make the chat/llm thread safe. 2023-06-20 18:18:10 -03:00
chatllm.h Get rid of last blocking operations and make the chat/llm thread safe. 2023-06-20 18:18:10 -03:00
chatmodel.h Fixed tons of warnings and clazy findings (#811) 2023-06-02 15:46:41 -04:00
CMakeLists.txt Enable Wayland in build 2023-06-26 14:58:23 -03:00
database.cpp Parse Org Mode files (#1038) 2023-06-22 09:09:39 -07:00
database.h Add a collection immediately and show a placeholder + busy indicator in localdocs settings. 2023-06-03 10:09:17 -04:00
download.cpp Support loading files if 'ggml' is found anywhere in the name not just at (#1001) 2023-06-16 11:09:33 -04:00
download.h Support loading files if 'ggml' is found anywhere in the name not just at (#1001) 2023-06-16 11:09:33 -04:00
LICENSE Moving everything to subdir for monorepo merge. 2023-05-10 10:26:55 -04:00
llm.cpp Move saving chats to a thread and display what we're doing to the user. 2023-06-20 17:18:33 -04:00
llm.h Move saving chats to a thread and display what we're doing to the user. 2023-06-20 17:18:33 -04:00
localdocs.cpp Add a collection immediately and show a placeholder + busy indicator in localdocs settings. 2023-06-03 10:09:17 -04:00
localdocs.h Make localdocs work with server mode. 2023-06-01 17:14:17 -04:00
localdocsdb.h Begin implementing the localdocs ui in earnest. 2023-05-25 11:28:06 -04:00
localdocsmodel.cpp Add a collection immediately and show a placeholder + busy indicator in localdocs settings. 2023-06-03 10:09:17 -04:00
localdocsmodel.h Add a collection immediately and show a placeholder + busy indicator in localdocs settings. 2023-06-03 10:09:17 -04:00
logger.cpp Logger should also output to stderr 2023-06-01 14:15:11 -04:00
logger.h Implemented logging mechanism (#785) 2023-06-01 16:50:42 +02:00
main.cpp Implemented logging mechanism (#785) 2023-06-01 16:50:42 +02:00
main.qml Move saving chats to a thread and display what we're doing to the user. 2023-06-20 17:18:33 -04:00
network.cpp We no longer have an avx_only repository and better error handling for minimum hardware requirements. (#833) 2023-06-04 15:28:58 -04:00
network.h Add ability to remove models. 2023-05-16 10:31:55 -04:00
README.md Fix typo in README 2023-05-17 09:56:20 -04:00
responsetext.cpp This needs to work even when localdocs and codeblocks are detected. 2023-06-20 19:07:02 -04:00
responsetext.h Add code blocks and python syntax highlighting. 2023-06-11 14:20:05 -07:00
server.cpp Allow Cross-Origin Resource Sharing (CORS) (#1008) 2023-06-22 09:19:49 -07:00
server.h Start working on more thread safety and model load error handling. 2023-06-20 14:39:22 -03:00
sysinfo.h Fixed tons of warnings and clazy findings (#811) 2023-06-02 15:46:41 -04:00

gpt4all-chat

Cross platform Qt based GUI for GPT4All versions with GPT-J as the base model. NOTE: The model seen in the screenshot is actually a preview of a new training run for GPT4All based on GPT-J. The GPT4All project is busy at work getting ready to release this model including installers for all three major OS's. In the meantime, you can try this UI out with the original GPT-J model by following build instructions below.

image

Install

One click installers for macOS, Linux, and Windows at https://gpt4all.io

Features

  • Cross-platform (Linux, Windows, MacOSX)
  • Fast CPU based inference using ggml for GPT-J based models
  • The UI is made to look and feel like you've come to expect from a chatty gpt
  • Check for updates so you can always stay fresh with latest models
  • Easy to install with precompiled binaries available for all three major desktop platforms
  • Multi-modal - Ability to load more than one model and switch between them
  • Supports both llama.cpp and gptj.cpp style models
  • Model downloader in GUI featuring many popular open source models
  • Settings dialog to change temp, top_p, top_k, threads, etc
  • Copy your conversation to clipboard
  • Check for updates to get the very latest GUI

Feature wishlist

  • Multi-chat - a list of current and past chats and the ability to save/delete/export and switch between
  • Text to speech - have the AI response with voice
  • Speech to text - give the prompt with your voice
  • Python bindings
  • Typescript bindings
  • Plugin support for langchain other developer tools
  • Save your prompt/responses to disk
  • Upload prompt/response manually/automatically to nomic.ai to aid future training runs
  • Syntax highlighting support for programming languages, etc.
  • REST API with a built-in webserver in the chat gui itself with a headless operation mode as well
  • Advanced settings for changing temperature, topk, etc. (DONE)
  • YOUR IDEA HERE

Building and running

Getting the latest

If you've already checked out the source code and/or built the program make sure when you do a git fetch to get the latest changes and that you also do git submodule update --init --recursive to update the submodules.

Manual download of models

Terminal Only Interface with no Qt dependency

Check out https://github.com/kuvaus/LlamaGPTJ-chat which is using the llmodel backend so it is compliant with our ecosystem and all models downloaded above should work with it.

Contributing

  • Pull requests welcome. See the feature wish list for ideas :)

License

The source code of this chat interface is currently under a MIT license. The underlying GPT4All-j model is released under non-restrictive open-source Apache 2 License.

The GPT4All-J license allows for users to use generated outputs as they see fit. Users take responsibility for ensuring their content meets applicable requirements for publication in a given context or region.