gpt4all/gpt4all-bindings
385olt b4dbbd1485
Python bindings: Custom callbacks, chat session improvement, refactoring (#1145)
* Added the following features: \n 1) Now prompt_model uses the positional argument callback to return the response tokens. \n 2) Due to the callback argument of prompt_model, prompt_model_streaming only manages the queue and threading now, which reduces duplication of the code. \n 3) Added optional verbose argument to prompt_model which prints out the prompt that is passed to the model. \n 4) Chat sessions can now have a header, i.e. an instruction before the transcript of the conversation. The header is set at the creation of the chat session context. \n 5) generate function now accepts an optional callback. \n 6) When streaming and using chat session, the user doesn't need to save assistant's messages by himself. This is done automatically.

* added _empty_response_callback so I don't have to check if callback is None

* added docs

* now if the callback stop generation, the last token is ignored

* fixed type hints, reimplemented chat session header as a system prompt, minor refactoring, docs: removed section about manual update of chat session for streaming

* forgot to add some type hints!

* keep the config of the model in GPT4All class which is taken from models.json if the download is allowed

* During chat sessions, the model-specific systemPrompt and promptTemplate are applied.

* implemented the changes

* Fixed typing. Now the user can set a prompt template that will be applied even outside of a chat session. The template can also have multiple placeholders that can be filled by passing a dictionary to the generate function

* reversed some changes concerning the prompt templates and their functionality

* fixed some type hints, changed list[float] to List[Float]

* fixed type hints, changed List[Float] to List[float]

* fix typo in the comment: Pepare => Prepare

---------

Signed-off-by: 385olt <385olt@gmail.com>
2023-07-19 18:36:49 -04:00
..
cli Fix CLI to work with 1.x.y version of the Python bindings (#1120) 2023-07-05 22:42:15 -04:00
csharp bump version 2023-07-11 18:09:39 -04:00
golang Allow to set a SetLibrarySearchPath in the golang bindings (#981) 2023-06-14 16:27:19 +02:00
java Java binding - Improve error check before loading Model file (#1206) 2023-07-15 18:07:42 -04:00
python Python bindings: Custom callbacks, chat session improvement, refactoring (#1145) 2023-07-19 18:36:49 -04:00
typescript typescript: publish alpha on npm and lots of cleanup, documentation, and more (#913) 2023-06-12 15:00:20 -04:00
README.md rough draft of monorepo plan 2023-05-01 15:45:39 -04:00

GPT4All Bindings

This directory will contain language specific bindings on top of the C/C++ model backends. We will have one directory per language binding (e.g. Python, Typescript, Golang, etc.).