AI/turbopilot
1
0
Fork 0
mirror of https://github.com/ravenscroftj/turbopilot.git synced 2024-06-25 22:02:08 +00:00
Code Issues Packages Projects Releases Wiki Activity

add cuda stuff to readme

Browse Source
This commit is contained in:
James Ravenscroft 2023-05-16 20:27:16 +01:00
parent ec1d897a00
commit d3f92176ca
1 changed files with 6 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

7
README.md
View File

@ -97,7 +97,12 @@ docker run --gpus=all --rm -it \
ghcr.io/ravenscroftj/turbopilot:v0.0.5-cuda
```
You should be able to see `/app/codegen-serve` listed when you run `nvidia-smi`.
You will need CUDA 11 or later to run this container. You should be able to see `/app/codegen-serve` listed when you run `nvidia-smi`.
#### Executable and CUDA
As of v0.0.5 a CUDA version of the linux executable is available - it requires that libcublas 11 be installed on the machine - I might build ubuntu debs at some point but for now running in docker may be more convenient if you want to use a CUDA GPU.
### 🌐 Using the API