fix: train gpt-j command

This commit is contained in:
Zach Nussbaum 2023-04-13 17:59:19 +00:00
parent a4e8616c76
commit 4903c4ca9f

View File

@ -67,7 +67,9 @@ Please see [GPT4All-J Technical Report]() for details.
### GPT4All-J Training Instructions
```bash
accelerate launch --dynamo_backend=inductor --num_processes=8 --num_machines=1 --machine_rank=0 --deepspeed_multinode_launcher standard --mixed_precision=bf16 --use_deepspeed --deepspeed_config_file=configs/deepspeed/ds_config_gptj.json train.py --config configs/train/finetune_gptj.yaml
```
# Original GPT4All Model (based on GPL Licensed LLaMa)