document generate.py

This commit is contained in:
Eric Wang 2023-03-13 17:42:46 -07:00
parent df2a5dc4be
commit 8f7447ea01

View File

@ -18,7 +18,8 @@ pip install -q git+https://github.com/huggingface/peft.git
# Inference
See `generate.py`.
See `generate.py`. This file reads the `decapoda-research/llama-7b-hf` model from the Huggingface model hub and the LoRA weights from `tloen/alpaca-lora-7b`, and runs inference on a specified input. Users should treat this as example code for the use of the model, and modify it as needed.
# Training