Juuso Alasuutari
5cfb1bda89
llmodel: add model wrapper destructor, fix mem leak in golang bindings ( #862 )
...
Signed-off-by: Juuso Alasuutari <juuso.alasuutari@gmail.com>
2023-06-12 09:41:22 -07:00
Aaron Miller
d3ba1295a7
Metal+LLama take two ( #929 )
...
Support latest llama with Metal
---------
Co-authored-by: Adam Treat <adam@nomic.ai>
Co-authored-by: niansa/tuxifan <tuxifan@posteo.de>
2023-06-09 16:48:46 -04:00
Richard Guo
e0a8480c0e
Generator in Python Bindings - streaming yields tokens at a time ( #895 )
...
* generator method
* cleanup
* bump version number for clarity
* added replace in decode to avoid unicodedecode exception
* revert back to _build_prompt
2023-06-09 10:17:44 -04:00
Claudius Ellsel
3c1b59f5c6
Move usage in Python bindings readme to own section ( #907 )
...
Have own section for short usage example, as it is not specific to local build
Signed-off-by: Claudius Ellsel <claudius.ellsel@live.de>
2023-06-09 10:13:35 +02:00
Claudius Ellsel
39a7c35d03
Update README.md ( #906 )
...
Add PyPI link and add clickable, more specific link to documentation
Signed-off-by: Claudius Ellsel <claudius.ellsel@live.de>
2023-06-08 13:43:31 -04:00
Richard Guo
c4706d0c14
Replit Model ( #713 )
...
* porting over replit code model to gpt4all
* replaced memory with kv_self struct
* continuing debug
* welp it built but lot of sus things
* working model loading and somewhat working generate.. need to format response?
* revert back to semi working version
* finally got rid of weird formatting
* figured out problem is with python bindings - this is good to go for testing
* addressing PR feedback
* output refactor
* fixed prompt reponse collection
* cleanup
* addressing PR comments
* building replit backend with new ggmlver code
* chatllm replit and clean python files
* cleanup
* updated replit to match new llmodel api
* match llmodel api and change size_t to Token
* resolve PR comments
* replit model commit comment
2023-06-06 17:09:00 -04:00
Andriy Mulyar
ef35eb496f
Supports downloading officially supported models not hosted on gpt4all R2
2023-06-06 16:21:02 -04:00
Andriy Mulyar
266f13aee9
Update gpt4all_faq.md ( #861 )
...
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-06-05 15:41:30 -04:00
Ettore Di Giacinto
44dc1ade62
Set thread counts after loading model ( #836 )
2023-06-05 21:35:40 +02:00
Andriy Mulyar
01071efc9c
Documentation for model sideloading ( #851 )
...
* Documentation for model sideloading
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
* Update gpt4all_chat.md
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
---------
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-06-05 12:35:02 -04:00
Richard Guo
f5f9f28f74
updated pypi version
2023-06-05 12:02:25 -04:00
Richard Guo
9d2b20f6cd
small typo fix
2023-06-02 12:32:26 -04:00
Richard Guo
e709e58603
more cleanup
2023-06-02 12:32:26 -04:00
Richard Guo
13fc50f2d3
cleanup
2023-06-02 12:32:26 -04:00
Richard Guo
c54c42e3fb
fixed finding model libs
2023-06-02 12:32:26 -04:00
Richard Guo
ab56364da8
load libs correctly
2023-06-02 12:32:26 -04:00
Richard Guo
5490af5a2c
model creation is failing... debugging
2023-06-02 12:32:26 -04:00
Richard Guo
9f203c211f
load all model libs
2023-06-02 12:32:26 -04:00
Richard Guo
ae42805d49
updated bindings code for updated C api
2023-06-02 12:32:26 -04:00
mvenditto
8e89ceb54b
C# Bindings - improved logging ( #714 )
...
* added optional support for .NET logging
* bump version and add missing alpha suffix
* avoid creating additional namespace for extensions
* prefer NullLogger/NullLoggerFactory over null-conditional ILogger to avoid errors
---------
Signed-off-by: mvenditto <venditto.matteo@gmail.com>
2023-06-01 21:01:27 +01:00
Andriy Mulyar
cf07ca3951
Update gpt4all_chat.md ( #800 )
...
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-06-01 15:35:06 -04:00
Tim Miller
87cb3505d3
Fix MSVC Build, Update C# Binding Scripts
2023-06-01 14:24:23 -04:00
Ettore Di Giacinto
022f1cabe7
Add ldl in gpt4all.go for dynamic linking ( #797 )
2023-06-01 19:50:08 +02:00
mudler
682a383e06
Drop leftover include
2023-06-01 13:03:44 -04:00
mudler
243c762411
Style
2023-06-01 10:36:22 -04:00
mudler
5220356273
Adapt makefile
2023-06-01 10:36:22 -04:00
mudler
19dd6c7635
Debug
2023-06-01 10:36:22 -04:00
mudler
7c7864ac72
Makefile changes (WIP to test)
2023-06-01 10:36:22 -04:00
mudler
79cef86bec
Adapt code
2023-06-01 10:36:22 -04:00
Andriy Mulyar
fca2578a81
Documentation improvements on LocalDocs ( #790 )
...
* Update gpt4all_chat.md
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
* typo
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
---------
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-06-01 10:29:29 -04:00
Andriy Mulyar
05d156fb97
Fixed formatting of localdocs docs ( #770 )
2023-05-30 16:19:48 -04:00
Andriy Mulyar
6ed9c1a8d8
Improved localdocs documentation ( #762 )
...
* Improved localdocs documentation
* Improved localdocs documentation
* Improved localdocs documentation
* Improved localdocs documentation
2023-05-30 11:26:34 -04:00
Andriy Mulyar
02290fd881
LocalDocs documentation initial ( #761 )
...
* LocalDocs documentation initial
2023-05-30 08:35:26 -04:00
mvenditto
9eb81cb549
C# Bindings - Prompt formatting ( #712 )
...
* Added support for custom prompt formatting
* more docs added
* bump version
2023-05-28 19:57:00 -04:00
Nandakumar
d101ca06d4
Update README.md ( #738 )
...
* Update README.md
fix golang gpt4all import path
Signed-off-by: Nandakumar <nandagunasekaran@gmail.com>
* Update README.md
Signed-off-by: Nandakumar <nandagunasekaran@gmail.com>
---------
Signed-off-by: Nandakumar <nandagunasekaran@gmail.com>
2023-05-28 19:51:11 -04:00
Joseph Mearman
020f64b9a4
tiny typo ( #739 )
2023-05-28 19:50:45 -04:00
Richard Guo
73db20ba85
hotfix default verbose optioin
2023-05-26 12:49:32 -04:00
Konstantin Gukov
a6f3e94458
one funcion to append .bin suffix
2023-05-26 09:24:03 -04:00
Konstantin Gukov
659244f0a2
Correct indentation of the multiline error message
2023-05-26 09:24:03 -04:00
Konstantin Gukov
5e61008424
Add optional verbosity
2023-05-26 09:24:03 -04:00
Konstantin Gukov
e05ee9466a
Correct return type
2023-05-26 09:24:03 -04:00
Konstantin Gukov
100c809f1e
Do not ignore explicitly passed 4 threads
2023-05-26 09:24:03 -04:00
Konstantin Gukov
dcbdd369ad
Redundant else
2023-05-26 09:24:03 -04:00
Konstantin Gukov
ace34afef2
1. Cleanup the interrupted download
...
2. with-syntax
2023-05-26 09:24:03 -04:00
Konstantin Gukov
8053dc014b
less magic number
2023-05-26 09:24:03 -04:00
Konstantin Gukov
e98cfd97b3
convert to f-strings
2023-05-26 09:24:03 -04:00
Konstantin Gukov
2b6fb7b95e
reduce nesting, better error reporting
2023-05-26 09:24:03 -04:00
Konstantin Gukov
a067f38544
Concise model matching
2023-05-26 09:24:03 -04:00
Konstantin Gukov
c1f3dd310c
Log where the model was found
2023-05-26 09:24:03 -04:00
Konstantin Gukov
f96300534b
Nicer handling of missing model directory.
...
Correct exception message.
2023-05-26 09:24:03 -04:00