mirror of
https://github.com/ravenscroftj/turbopilot.git
synced 2024-10-01 01:06:01 -04:00
757 B
757 B
TurboPilot
TurboPilot is a super fast fauxpilot clone which uses the library behind llama.cpp to run huge 6 Billion Parameter Salesforce Codegen models in 2GiB of RAM.
Getting Started
git clone https://github.com/ravenscroftj/turbopilot
git submodule init
cd ggml
mkdir build
cd build
cmake ..
make codegen
Getting The Models
Start by downloading either the 2B or 6B GPT-J versions of CodeGen.
Convert The Model
python convert-codegen-to-ggml.py ./codegen-6B-multi-gptj 0