AI/alpaca-lora
1
0
Fork 0
mirror of https://github.com/tloen/alpaca-lora.git synced 2024-10-01 01:05:56 -04:00
Code Issues Packages Projects Releases Wiki Activity

To-dos, etc

Browse Source
This commit is contained in:
Eric Wang 2023-03-13 17:50:38 -07:00
parent 6707775517
commit a7ccc3603e
1 changed files with 11 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

13
README.md
View File

@ -1,4 +1,4 @@
## alpaca-lora (WIP) ## 🦙🌲🤏 Alpaca (Low-Rank Edition)
This repository contains code for reproducing the [Stanford Alpaca results](https://github.com/tatsu-lab/stanford_alpaca#data-release). Users will need to be ready to fork `transformers`. This repository contains code for reproducing the [Stanford Alpaca results](https://github.com/tatsu-lab/stanford_alpaca#data-release). Users will need to be ready to fork `transformers`.
@ -23,4 +23,13 @@ See `generate.py`. This file reads the `decapoda-research/llama-7b-hf` model fro
### Training ### Training
Under construction. Under construction.
### To do
- [ ] Hyperparameter tuning
- [ ] Documentation for notebook
- [ ] Support for `13b`, `30b`, `65b`
- [ ] Inference CLI and evaluation
- [ ] Better disclaimers about why using LLaMA without permission is very bad!