AI/stanford_alpaca
1
0
Fork 0
mirror of https://github.com/tatsu-lab/stanford_alpaca.git synced 2024-10-01 05:35:37 -04:00
Code Issues Packages Projects Releases Wiki Activity

Merge pull request #18 from eltociear/patch-1

Browse Source 
Update README.md
This commit is contained in:
Rohan Taori 2023-03-14 17:46:30 -07:00 committed by GitHub
commit 032f6e24f2
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
README.md
View File

@ -91,7 +91,7 @@ The inner circle of the plot represents the root verb of the instructions, and t
[<img src="assets/parse_analysis.png" width="750" />](./assets/parse_analysis.png)
## Fine-tuning
We fine-tune our model using standard huggingface training code with the following hyperparameters:
We fine-tune our model using standard Hugging Face training code with the following hyperparameters:
| Hyperparameter | Value |
|----------------|-------|
@ -101,7 +101,7 @@ We fine-tune our model using standard huggingface training code with the followi
| Max length | 512 |
| Weight decay | 1 |
We are waiting for huggingface to officially support the llama models (i.e. this [PR](https://github.com/huggingface/transformers/pull/21955) to be merged) before we release a stable version of the finetuning code.
We are waiting for Hugging Face to officially support the llama models (i.e. this [PR](https://github.com/huggingface/transformers/pull/21955) to be merged) before we release a stable version of the finetuning code.
### Authors
All grad students below contributed equally and the order is determined by random draw.