turbopilot/README.md

TurboPilot

TurboPilot is a super fast fauxpilot clone which uses the library behind llama.cpp to run huge 6 Billion Parameter Salesforce Codegen models in 2GiB of RAM.

Getting Started

git clone https://github.com/ravenscroftj/turbopilot
git submodule init
cd ggml
mkdir build
cd build
cmake ..
make codegen

Getting The Models

Start by downloading either the 2B or 6B GPT-J versions of CodeGen.

Convert The Model

python convert-codegen-to-ggml.py ./codegen-6B-multi-gptj 0

Build GGML