Aaron Miller
6a74e515e1
bindings/python: make target to set up env
2023-06-30 21:07:21 -03:00
Aaron Miller
ac5c8e964f
bindings/python: fix typo ( #1111 )
2023-06-30 17:00:42 -04:00
Andriy Mulyar
46a0762bd5
Python Bindings: Improved unit tests, documentation and unification of API ( #1090 )
...
* Makefiles, black, isort
* Black and isort
* unit tests and generation method
* chat context provider
* context does not reset
* Current state
* Fixup
* Python bindings with unit tests
* GPT4All Python Bindings: chat contexts, tests
* New python bindings and backend fixes
* Black and Isort
* Documentation error
* preserved n_predict for backwords compat with langchain
---------
Co-authored-by: Adam Treat <treat.adam@gmail.com>
2023-06-30 16:02:02 -04:00
Andriy Mulyar
6b8456bf99
Update README.md ( #1086 )
...
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-06-28 12:15:05 -04:00
AMOGUS
b8464073b8
Update gpt4all_chat.md ( #1050 )
...
* Update gpt4all_chat.md
Cleaned up and made the sideloading part more readable, also moved Replit architecture to supported ones. (+ renamed all "ggML" to "GGML" because who calls it "ggML"??)
Signed-off-by: AMOGUS <137312610+Amogus8P@users.noreply.github.com>
* Removed the prefixing part
Signed-off-by: AMOGUS <137312610+Amogus8P@users.noreply.github.com>
* Bump version
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
---------
Signed-off-by: AMOGUS <137312610+Amogus8P@users.noreply.github.com>
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
Co-authored-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-06-27 10:49:45 -04:00
Aaron Miller
b19a3e5b2c
add requiredMem method to llmodel impls
...
most of these can just shortcut out of the model loading logic llama is a bit worse to deal with because we submodule it so I have to at least parse the hparams, and then I just use the size on disk as an estimate for the mem size (which seems reasonable since we mmap() the llama files anyway)
2023-06-26 18:27:58 -03:00
cosmic-snow
ee26e8f271
CLI Improvements ( #1021 )
...
* Add gpt4all-bindings/cli/README.md
* Unify version information
- Was previously split; base one on the other
- Add VERSION_INFO as the "source of truth":
- Modelled after sys.version_info.
- Implemented as a tuple, because it's much easier for (partial)
programmatic comparison.
- Previous API is kept intact.
* Add gpt4all-bindings/cli/developer_notes.md
- A few notes on what's what, especially regarding docs
* Add gpt4all-bindings/python/docs/gpt4all_cli.md
- The CLI user documentation
* Bump CLI version to 0.3.5
* Finalise docs & add to index.md
- Amend where necessary
- Fix typo in gpt4all_cli.md
- Mention and add link to CLI doc in index.md
* Add docstings to gpt4all-bindings/cli/app.py
* Better 'groovy' link & fix typo
- Documentation: point to the Hugging Face model card for 'groovy'
- Correct typo in app.py
2023-06-23 12:09:31 -07:00
EKal-aa
aed7b43143
set n_threads in GPT4All python bindings ( #1042 )
...
* set n_threads in GPT4All
* changed default n_threads to None
2023-06-23 01:16:35 -07:00
Martin Mauch
af28173a25
Parse Org Mode files ( #1038 )
2023-06-22 09:09:39 -07:00
Richard Guo
a39a897e34
0.3.5 bump
2023-06-20 10:21:51 -04:00
Richard Guo
25ce8c6a1e
revert version
2023-06-20 10:21:51 -04:00
Richard Guo
282a3b5498
setup.py update
2023-06-20 10:21:51 -04:00
cosmic-snow
b00ac632e3
Update python/README.md with troubleshooting info ( #1012 )
...
- Add some notes about common Windows problems when trying to make a local build (MinGW and MSVC).
Signed-off-by: cosmic-snow <134004613+cosmic-snow@users.noreply.github.com>
2023-06-18 14:08:43 -04:00
standby24x7
cdea838671
Fix spelling typo in gpt4all.py ( #1007 )
...
Signed-off-by: Masanari Iida <standby24x7@gmail.com>
2023-06-18 14:07:46 -04:00
Richard Guo
a9b33c3d10
update setup.py
2023-06-13 09:07:08 -04:00
Richard Guo
a99cc34efb
fix prompt context so it's preserved in class
2023-06-13 09:07:08 -04:00
Richard Guo
5a0b348219
second hold for pypi deploy
2023-06-12 23:11:54 -04:00
Richard Guo
014205a916
dummy python change
2023-06-12 23:11:54 -04:00
Richard Guo
e9449190cd
version bump
2023-06-12 17:32:56 -04:00
Aaron Miller
d3ba1295a7
Metal+LLama take two ( #929 )
...
Support latest llama with Metal
---------
Co-authored-by: Adam Treat <adam@nomic.ai>
Co-authored-by: niansa/tuxifan <tuxifan@posteo.de>
2023-06-09 16:48:46 -04:00
Richard Guo
e0a8480c0e
Generator in Python Bindings - streaming yields tokens at a time ( #895 )
...
* generator method
* cleanup
* bump version number for clarity
* added replace in decode to avoid unicodedecode exception
* revert back to _build_prompt
2023-06-09 10:17:44 -04:00
Claudius Ellsel
3c1b59f5c6
Move usage in Python bindings readme to own section ( #907 )
...
Have own section for short usage example, as it is not specific to local build
Signed-off-by: Claudius Ellsel <claudius.ellsel@live.de>
2023-06-09 10:13:35 +02:00
Claudius Ellsel
39a7c35d03
Update README.md ( #906 )
...
Add PyPI link and add clickable, more specific link to documentation
Signed-off-by: Claudius Ellsel <claudius.ellsel@live.de>
2023-06-08 13:43:31 -04:00
Richard Guo
c4706d0c14
Replit Model ( #713 )
...
* porting over replit code model to gpt4all
* replaced memory with kv_self struct
* continuing debug
* welp it built but lot of sus things
* working model loading and somewhat working generate.. need to format response?
* revert back to semi working version
* finally got rid of weird formatting
* figured out problem is with python bindings - this is good to go for testing
* addressing PR feedback
* output refactor
* fixed prompt reponse collection
* cleanup
* addressing PR comments
* building replit backend with new ggmlver code
* chatllm replit and clean python files
* cleanup
* updated replit to match new llmodel api
* match llmodel api and change size_t to Token
* resolve PR comments
* replit model commit comment
2023-06-06 17:09:00 -04:00
Andriy Mulyar
ef35eb496f
Supports downloading officially supported models not hosted on gpt4all R2
2023-06-06 16:21:02 -04:00
Andriy Mulyar
266f13aee9
Update gpt4all_faq.md ( #861 )
...
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-06-05 15:41:30 -04:00
Andriy Mulyar
01071efc9c
Documentation for model sideloading ( #851 )
...
* Documentation for model sideloading
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
* Update gpt4all_chat.md
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
---------
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-06-05 12:35:02 -04:00
Richard Guo
f5f9f28f74
updated pypi version
2023-06-05 12:02:25 -04:00
Richard Guo
9d2b20f6cd
small typo fix
2023-06-02 12:32:26 -04:00
Richard Guo
e709e58603
more cleanup
2023-06-02 12:32:26 -04:00
Richard Guo
13fc50f2d3
cleanup
2023-06-02 12:32:26 -04:00
Richard Guo
c54c42e3fb
fixed finding model libs
2023-06-02 12:32:26 -04:00
Richard Guo
ab56364da8
load libs correctly
2023-06-02 12:32:26 -04:00
Richard Guo
5490af5a2c
model creation is failing... debugging
2023-06-02 12:32:26 -04:00
Richard Guo
9f203c211f
load all model libs
2023-06-02 12:32:26 -04:00
Richard Guo
ae42805d49
updated bindings code for updated C api
2023-06-02 12:32:26 -04:00
Andriy Mulyar
cf07ca3951
Update gpt4all_chat.md ( #800 )
...
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-06-01 15:35:06 -04:00
Andriy Mulyar
fca2578a81
Documentation improvements on LocalDocs ( #790 )
...
* Update gpt4all_chat.md
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
* typo
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
---------
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-06-01 10:29:29 -04:00
Andriy Mulyar
05d156fb97
Fixed formatting of localdocs docs ( #770 )
2023-05-30 16:19:48 -04:00
Andriy Mulyar
6ed9c1a8d8
Improved localdocs documentation ( #762 )
...
* Improved localdocs documentation
* Improved localdocs documentation
* Improved localdocs documentation
* Improved localdocs documentation
2023-05-30 11:26:34 -04:00
Andriy Mulyar
02290fd881
LocalDocs documentation initial ( #761 )
...
* LocalDocs documentation initial
2023-05-30 08:35:26 -04:00
Richard Guo
73db20ba85
hotfix default verbose optioin
2023-05-26 12:49:32 -04:00
Konstantin Gukov
a6f3e94458
one funcion to append .bin suffix
2023-05-26 09:24:03 -04:00
Konstantin Gukov
659244f0a2
Correct indentation of the multiline error message
2023-05-26 09:24:03 -04:00
Konstantin Gukov
5e61008424
Add optional verbosity
2023-05-26 09:24:03 -04:00
Konstantin Gukov
e05ee9466a
Correct return type
2023-05-26 09:24:03 -04:00
Konstantin Gukov
dcbdd369ad
Redundant else
2023-05-26 09:24:03 -04:00
Konstantin Gukov
ace34afef2
1. Cleanup the interrupted download
...
2. with-syntax
2023-05-26 09:24:03 -04:00
Konstantin Gukov
8053dc014b
less magic number
2023-05-26 09:24:03 -04:00
Konstantin Gukov
e98cfd97b3
convert to f-strings
2023-05-26 09:24:03 -04:00
Konstantin Gukov
2b6fb7b95e
reduce nesting, better error reporting
2023-05-26 09:24:03 -04:00
Konstantin Gukov
a067f38544
Concise model matching
2023-05-26 09:24:03 -04:00
Konstantin Gukov
c1f3dd310c
Log where the model was found
2023-05-26 09:24:03 -04:00
Konstantin Gukov
f96300534b
Nicer handling of missing model directory.
...
Correct exception message.
2023-05-26 09:24:03 -04:00
Konstantin Gukov
59d7db9aad
More precise condition
2023-05-26 09:24:03 -04:00
Konstantin Gukov
adc599b0a6
rm redundant json
2023-05-26 09:24:03 -04:00
Andriy Mulyar
b40cd065e9
Update index.md ( #689 )
...
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-05-22 17:29:01 -07:00
Andriy Mulyar
efd39b0d73
Improved documentation landing page ( #665 )
...
* Better doc landing page
* Typo
* Improved docs landing page
2023-05-21 23:14:18 -04:00
Juuso Alasuutari
08ece43f0d
llmodel: fix wrong and/or missing prompt callback type
...
Fix occurrences of the prompt callback being incorrectly specified, or
the response callback's prototype being incorrectly used in its place.
Signed-off-by: Juuso Alasuutari <juuso.alasuutari@gmail.com>
2023-05-21 16:02:11 -04:00
Richard Guo
213e033540
GPT4All Updated Docs and FAQ ( #632 )
...
* working on docs
* more doc organization
* faq
* some reformatting
2023-05-18 16:07:57 -04:00
Richard Guo
8bc9a4ca83
fixed response formatting when streaming
2023-05-18 12:02:11 -04:00
Richard Guo
d1b17e1fb3
updating pip version
2023-05-18 12:02:11 -04:00
Richard Guo
057b9f51bc
deploying new version with streaming
2023-05-18 12:02:11 -04:00
drbh
d4861030b7
adds a simple cli chat repl ( #566 )
...
* adds a simple cli chat repl
* add n thread support and append assistant response
2023-05-16 16:47:54 -04:00
Richard Guo
e659ef5b2a
Improvements to documentation ( #606 )
2023-05-16 15:29:27 -04:00
Andriy Mulyar
bc481f2ab7
Chat doc typo ( #605 )
...
* Added modal labs example to documentation
* Added gpt4all chat
* Typo
* Andriy can't spell
2023-05-16 14:33:34 -04:00
Andriy Mulyar
5528e37660
Chat doc fixes ( #604 )
...
* Added modal labs example to documentation
* Added gpt4all chat
* Typo
---------
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-05-16 14:23:37 -04:00
Andriy Mulyar
96cedc2558
Added better documentation to web server example in docs ( #603 )
...
* Added modal labs example to documentation
* Added gpt4all chat
2023-05-16 14:17:35 -04:00
Andriy Mulyar
3b407a3bd1
Update gpt4all_chat.md ( #601 )
...
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-05-16 13:15:00 -04:00
Andriy Mulyar
9b70bb0714
Typo ( #600 )
...
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-05-16 13:07:27 -04:00
Andriy Mulyar
8e3728f60e
Update gpt4all_chat.md ( #598 )
...
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-05-16 13:02:19 -04:00
Andriy Mulyar
e424f9bd5a
Update gpt4all_chat.md ( #597 )
...
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-05-16 12:58:05 -04:00
Andriy Mulyar
17de7f0529
Chat Client Documentation ( #596 )
...
* GPT4All Chat Client Documentation
* Updated documentation wording
2023-05-16 12:46:31 -04:00
Yaroslav Halchenko
c942780f5a
[DATALAD RUNCMD] run codespell throughout
...
=== Do not change lines below ===
{
"chain": [],
"cmd": "codespell -w",
"exit": 0,
"extra_inputs": [],
"inputs": [],
"outputs": [],
"pwd": "."
}
^^^ Do not change lines above ^^^
2023-05-16 11:33:59 -04:00
AT
31452769a4
Update README.md
...
Signed-off-by: AT <manyoso@users.noreply.github.com>
2023-05-14 07:41:45 -04:00
Richard Guo
0f71cb6759
Update README.md ( #561 )
...
Signed-off-by: Richard Guo <richardg7890@gmail.com>
2023-05-13 14:43:46 -04:00
Andriy Mulyar
f455b2f005
Modal labs python docs ( #558 )
...
* Added modal labs example to documentation
* Modal snippet update docs
---------
Signed-off-by: Andriy Mulyar <andriy.mulyar@gmail.com>
2023-05-13 13:52:37 -04:00
Andriy Mulyar
d94f37c1bf
Added modal labs example to documentation ( #556 )
2023-05-13 11:10:18 -04:00
Richard Guo
57ba554478
fixed bug in readme
2023-05-12 15:21:56 -04:00
Richard Guo
7387be08f6
mpt pypi job
2023-05-12 15:21:56 -04:00
Richard Guo
025bae02a3
gpt4all mpt bindings
2023-05-12 15:21:56 -04:00
Richard Guo
36a6e824f0
mpt bindings
2023-05-12 15:21:56 -04:00
Richard Guo
af53e8ee22
working circleci and updated readme
2023-05-12 10:47:46 -04:00
Richard Guo
3bb03ce85b
forgot obvious things
2023-05-12 10:21:13 -04:00
Richard Guo
3368924229
documentation and cleanup
2023-05-11 11:02:44 -04:00
Richard Guo
113d04dce3
some cleanup and for job specific names for circleci
2023-05-10 16:40:24 -04:00
Richard Guo
3668cf00cf
clean up and jank windows wheel build
2023-05-10 15:58:27 -04:00
Richard Guo
d59ae64fa7
fixed paths for c lib
2023-05-10 14:07:56 -04:00
Richard Guo
239a5c14ef
refactor circle ci config
2023-05-10 13:57:54 -04:00
Richard Guo
6ee9659905
updated README with new paths
2023-05-10 13:48:36 -04:00
Richard Guo
4cec72fe75
updated path
2023-05-10 13:41:19 -04:00
Richard Guo
8c84c24ee9
transfer python bindings code
2023-05-10 13:38:32 -04:00
Richard Guo
02d1bdb0be
mono repo structure
2023-05-01 15:45:23 -04:00