AI/stanford_alpaca
1
0
Fork 0
mirror of https://github.com/tatsu-lab/stanford_alpaca.git synced 2024-10-01 05:35:37 -04:00
Code Issues Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
Rohan Taori 2023-03-15 11:03:26 -07:00 committed by GitHub
parent 9a14edbc84
commit 3a50f614fc
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
README.md
View File

@ -166,7 +166,7 @@ torchrun --nproc_per_node=4 --master_port=<your_random_port> train.py \
``` ```
Note the given training script is meant to be simple and easy to use, and is not particularly optimized. Note the given training script is meant to be simple and easy to use, and is not particularly optimized.
To run on more gpus, you may prefer to turn down `gradient_accumulation_steps` to keep a global batch size of 128. Batch size has not been tested for optimality. To run on more gpus, you may prefer to turn down `gradient_accumulation_steps` to keep a global batch size of 128. Global batch size has not been tested for optimality.
### Authors ### Authors
All grad students below contributed equally and the order is determined by random draw. All grad students below contributed equally and the order is determined by random draw.