88d85be0f9
* chat: remove unused oscompat source files
These files are no longer needed now that the hnswlib index is gone.
This fixes an issue with the Windows build as there was a compilation
error in oscompat.cpp.
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
* llm: fix pragma to be recognized by MSVC
Replaces this MSVC warning:
C:\msys64\home\Jared\gpt4all\gpt4all-chat\llm.cpp(53,21): warning C4081: expected '('; found 'string'
With this:
C:\msys64\home\Jared\gpt4all\gpt4all-chat\llm.cpp : warning : offline installer build will not check for updates!
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
* usearch: fork usearch to fix `CreateFile` build error
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
* dlhandle: fix incorrect assertion on Windows
SetErrorMode returns the previous value of the error mode flags, not an
indicator of success.
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
* llamamodel: fix UB in LLamaModel::embedInternal
It is undefined behavior to increment an STL iterator past the end of
the container. Use offsets to do the math instead.
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
* cmake: install embedding model to bundle's Resources dir on macOS
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
* ci: fix macOS build by explicitly installing Rosetta
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
---------
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
|
||
|---|---|---|
| .. | ||
| cmake | ||
| flatpak-manifest | ||
| icons | ||
| metadata | ||
| qml | ||
| resources | ||
| usearch@22cfa3bd00 | ||
| build_and_run.md | ||
| chat.cpp | ||
| chat.h | ||
| chatapi.cpp | ||
| chatapi.h | ||
| chatlistmodel.cpp | ||
| chatlistmodel.h | ||
| chatllm.cpp | ||
| chatllm.h | ||
| chatmodel.h | ||
| CMakeLists.txt | ||
| database.cpp | ||
| database.h | ||
| download.cpp | ||
| download.h | ||
| embllm.cpp | ||
| embllm.h | ||
| LICENSE | ||
| llm.cpp | ||
| llm.h | ||
| localdocs.cpp | ||
| localdocs.h | ||
| localdocsmodel.cpp | ||
| localdocsmodel.h | ||
| logger.cpp | ||
| logger.h | ||
| main.cpp | ||
| main.qml | ||
| modellist.cpp | ||
| modellist.h | ||
| mysettings.cpp | ||
| mysettings.h | ||
| network.cpp | ||
| network.h | ||
| qa_checklist.md | ||
| README.md | ||
| responsetext.cpp | ||
| responsetext.h | ||
| server.cpp | ||
| server.h | ||
gpt4all-chat
Cross platform Qt based GUI for GPT4All versions with GPT-J as the base model. NOTE: The model seen in the screenshot is actually a preview of a new training run for GPT4All based on GPT-J. The GPT4All project is busy at work getting ready to release this model including installers for all three major OS's. In the meantime, you can try this UI out with the original GPT-J model by following build instructions below.
Install
One click installers for macOS, Linux, and Windows at https://gpt4all.io
Features
- Cross-platform (Linux, Windows, MacOSX)
- Fast CPU based inference using ggml for GPT-J based models
- The UI is made to look and feel like you've come to expect from a chatty gpt
- Check for updates so you can always stay fresh with latest models
- Easy to install with precompiled binaries available for all three major desktop platforms
- Multi-modal - Ability to load more than one model and switch between them
- Supports both llama.cpp and gptj.cpp style models
- Model downloader in GUI featuring many popular open source models
- Settings dialog to change temp, top_p, top_k, threads, etc
- Copy your conversation to clipboard
- Check for updates to get the very latest GUI
Feature wishlist
- Multi-chat - a list of current and past chats and the ability to save/delete/export and switch between
- Text to speech - have the AI response with voice
- Speech to text - give the prompt with your voice
- Plugin support for langchain other developer tools
- chat gui headless operation mode
- Advanced settings for changing temperature, topk, etc. (DONE)
-
- Improve the accessibility of the installer for screen reader users
- YOUR IDEA HERE
Building and running
- Follow the visual instructions on the build_and_run page
Getting the latest
If you've already checked out the source code and/or built the program make sure when you do a git fetch to get the latest changes and that you also do git submodule update --init --recursive to update the submodules.
Manual download of models
- You can find a 'Model Explorer' on the official website where you can manually download models that we support: https://gpt4all.io/index.html
Terminal Only Interface with no Qt dependency
Check out https://github.com/kuvaus/LlamaGPTJ-chat which is using the llmodel backend so it is compliant with our ecosystem and all models downloaded above should work with it.
Contributing
- Pull requests welcome. See the feature wish list for ideas :)
License
The source code of this chat interface is currently under a MIT license. The underlying GPT4All-j model is released under non-restrictive open-source Apache 2 License.
The GPT4All-J license allows for users to use generated outputs as they see fit. Users take responsibility for ensuring their content meets applicable requirements for publication in a given context or region.