gpt4all/gpt4all-bindings
Jared Van Bortel 061d1969f8
expose n_gpu_layers parameter of llama.cpp (#1890)
Also dynamically limit the GPU layers and context length fields to the maximum supported by the model.

Signed-off-by: Jared Van Bortel <jared@nomic.ai>
2024-01-31 14:17:44 -05:00
..
cli app.py: add --device option for GPU support (#1769) 2023-12-20 16:01:03 -05:00
csharp expose n_gpu_layers parameter of llama.cpp (#1890) 2024-01-31 14:17:44 -05:00
golang expose n_gpu_layers parameter of llama.cpp (#1890) 2024-01-31 14:17:44 -05:00
java expose n_gpu_layers parameter of llama.cpp (#1890) 2024-01-31 14:17:44 -05:00
python expose n_gpu_layers parameter of llama.cpp (#1890) 2024-01-31 14:17:44 -05:00
typescript expose n_gpu_layers parameter of llama.cpp (#1890) 2024-01-31 14:17:44 -05:00
README.md rough draft of monorepo plan 2023-05-01 15:45:39 -04:00

GPT4All Bindings

This directory will contain language specific bindings on top of the C/C++ model backends. We will have one directory per language binding (e.g. Python, Typescript, Golang, etc.).