mirror of
https://github.com/ravenscroftj/turbopilot.git
synced 2024-09-29 20:25:56 +00:00
add readme
This commit is contained in:
parent
aced738285
commit
f76105eecb
27
README.md
Normal file
27
README.md
Normal file
@ -0,0 +1,27 @@
|
|||||||
|
# TurboPilot
|
||||||
|
|
||||||
|
TurboPilot is a super fast [fauxpilot](https://github.com/fauxpilot/fauxpilot) clone which uses the library behind [llama.cpp](https://github.com/comex/llama.cpp) to run huge [6 Billion Parameter Salesforce Codegen models](https://github.com/salesforce/CodeGen) in 2GiB of RAM.
|
||||||
|
|
||||||
|
## Getting Started
|
||||||
|
|
||||||
|
```bash
|
||||||
|
git clone https://github.com/ravenscroftj/turbopilot
|
||||||
|
git submodule init
|
||||||
|
cd ggml
|
||||||
|
mkdir build
|
||||||
|
cd build
|
||||||
|
cmake ..
|
||||||
|
make codegen
|
||||||
|
```
|
||||||
|
|
||||||
|
## Getting The Models
|
||||||
|
|
||||||
|
Start by downloading either the [2B](https://huggingface.co/moyix/codegen-2B-multi-gptj) or [6B](https://huggingface.co/moyix/codegen-6B-multi-gptj) GPT-J versions of CodeGen.
|
||||||
|
|
||||||
|
## Convert The Model
|
||||||
|
|
||||||
|
```bash
|
||||||
|
python convert-codegen-to-ggml.py ./codegen-6B-multi-gptj 0
|
||||||
|
```
|
||||||
|
|
||||||
|
## Build GGML
|
Loading…
Reference in New Issue
Block a user