mirror of
https://github.com/tatsu-lab/stanford_alpaca.git
synced 2024-10-01 05:35:37 -04:00
Update README.md
huggingface -> Hugging Face
This commit is contained in:
parent
da37bb2eca
commit
f222e56f1f
@ -89,7 +89,7 @@ The inner circle of the plot represents the root verb of the instructions, and t
|
||||
[<img src="assets/parse_analysis.png" width="750" />](./assets/parse_analysis.png)
|
||||
|
||||
## Fine-tuning
|
||||
We fine-tune our model using standard huggingface training code with the following hyperparameters:
|
||||
We fine-tune our model using standard Hugging Face training code with the following hyperparameters:
|
||||
|
||||
| Hyperparameter | Value |
|
||||
|----------------|-------|
|
||||
@ -99,7 +99,7 @@ We fine-tune our model using standard huggingface training code with the followi
|
||||
| Max length | 512 |
|
||||
| Weight decay | 1 |
|
||||
|
||||
We are waiting for huggingface to officially support the llama models (i.e. this [PR](https://github.com/huggingface/transformers/pull/21955) to be merged) before we release a stable version of the finetuning code.
|
||||
We are waiting for Hugging Face to officially support the llama models (i.e. this [PR](https://github.com/huggingface/transformers/pull/21955) to be merged) before we release a stable version of the finetuning code.
|
||||
|
||||
### Authors
|
||||
All grad students below contributed equally and the order is determined by random draw.
|
||||
|
Loading…
Reference in New Issue
Block a user