Jared Van Bortel d2a99d9bc6 support the llama.cpp CUDA backend (#2310) ... * rebase onto llama.cpp commit ggerganov/llama.cpp@d46dbc76f * support for CUDA backend (enabled by default) * partial support for Occam's Vulkan backend (disabled by default) * partial support for HIP/ROCm backend (disabled by default) * sync llama.cpp.cmake with upstream llama.cpp CMakeLists.txt * changes to GPT4All backend, bindings, and chat UI to handle choice of llama.cpp backend (Kompute or CUDA) * ship CUDA runtime with installed version * make device selection in the UI on macOS actually do something * model whitelist: remove dbrx, mamba, persimmon, plamo; add internlm and starcoder2 Signed-off-by: Jared Van Bortel <jared@nomic.ai>		2024-05-15 15:27:50 -04:00
..
config.yml	ci: run all workflows when the backend updates	2024-02-09 15:35:02 -05:00
continue_config.yml	support the llama.cpp CUDA backend (#2310)	2024-05-15 15:27:50 -04:00