Jared Van Bortel
f2e5c931fe
rename ChatLLM to LlamaCppModel
...
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
2024-08-08 15:14:58 -04:00
Jared Van Bortel
5be5314ace
rename LLModel -> ModelBackend, EmbLLModel -> EmbCapableBackend
...
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
2024-08-07 17:53:58 -04:00
Jared Van Bortel
595501fcde
backend: move more stuff into LlamaCppBackend
...
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
2024-08-07 11:33:50 -04:00
Jared Van Bortel
be66ec8ab5
chat: faster KV shift, continue generating, fix stop sequences ( #2781 )
...
* Don't stop generating at end of context
* Use llama_kv_cache ops to shift context
* Fix and improve reverse prompt detection
* Replace prompt recalc callback with a flag to disallow context shift
2024-08-07 11:25:24 -04:00
不知火 Shiranui
f9cd2e321c
feat: add openai-compatible api models ( #2683 )
...
Signed-off-by: Shiranui <supersonic@livemail.tw>
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
Co-authored-by: Jared Van Bortel <jared@nomic.ai>
2024-07-25 10:02:52 -04:00
AT
9273b49b62
chat: major UI redesign for v3.0.0 ( #2396 )
...
Signed-off-by: Adam Treat <treat.adam@gmail.com>
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
Co-authored-by: Jared Van Bortel <jared@nomic.ai>
2024-06-24 18:49:23 -04:00
Jared Van Bortel
d3d777bc51
chat: fix #includes with include-what-you-use ( #2401 )
...
Also use qGuiApp instead of qApp.
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
2024-06-04 14:47:11 -04:00
Olyxz16
2c0a660e6e
feat: Add support for Mistral API models ( #2053 )
...
Signed-off-by: Jared Van Bortel <jared@nomic.ai>
Signed-off-by: Cédric Sazos <cedric.sazos@tutanota.com>
Co-authored-by: Jared Van Bortel <jared@nomic.ai>
2024-03-13 18:23:57 -04:00
