AI/turbopilot
1
0
Fork 0
mirror of https://github.com/ravenscroftj/turbopilot.git synced 2024-06-28 23:32:20 +00:00
Code Issues Packages Projects Releases Wiki Activity

add docker instructions

Browse Source
This commit is contained in:
James Ravenscroft 2023-04-10 10:48:42 +01:00
parent d79e05bef8
commit 1884bb1c91
1 changed files with 15 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

15
README.md
View File

@ -40,6 +40,21 @@ If you have a multi-core system you can control how many CPUs are used with the
./codegen-serve -t 6 -m ./models/codegen-6B-multi-ggml-4bit-quant.bin
```
### Running From Docker
You can also run Turbopilot from the pre-built docker image supplied [here](https://github.com/users/ravenscroftj/packages/container/package/turbopilot%2Fturbopilot)
You will still need to download the models separately, then you can run:
```bash
docker run --rm -it \
-v ./models:/models \
-e THREADS=6 \
-e MODEL="/models/codegen-2B-multi-ggml-4bit-quant.bin" \
-p 18080:18080 \
ghcr.io/ravenscroftj/turbopilot/turbopilot:latest
```
### Using the API
#### Using the API with FauxPilot Plugin