Commit Graph

1580 Commits

Author SHA1 Message Date
bstadt
4e8e7e7300 metrics run on configs now 2023-03-28 00:09:47 +00:00
bstadt
d5769d7614 removed swp 2023-03-27 22:00:09 +00:00
bstadt
444871189d added eval configs 2023-03-27 21:59:40 +00:00
bstadt
b48a52d934 started eval script and added eval data 2023-03-27 21:50:08 +00:00
Zach Nussbaum
29cb9d700a Merge branch 'train' of github.com:nomic-ai/gpt4all into train 2023-03-27 17:39:39 +00:00
Zach Nussbaum
f2e122ff82 fix: add prompt 2023-03-27 17:39:29 +00:00
Zach Nussbaum
d87af69a93 fix: add tokens 2023-03-27 17:39:20 +00:00
Zach Nussbaum
ed08006053 feat: lora config 2023-03-27 17:33:13 +00:00
Zach Nussbaum
80227dc164 feat: full model config 2023-03-27 17:30:57 +00:00
Zach Nussbaum
1a95f68494 fix: just read from watermark file 2023-03-27 17:30:44 +00:00
Zach Nussbaum
b369e5a30f fix: naming 2023-03-27 17:30:33 +00:00
Zach Nussbaum
b24ca03dc4 fix: append first_epoch 2023-03-27 17:30:24 +00:00
Zach Nussbaum
8e22a7276f chore: gitignore 2023-03-27 16:33:00 +00:00
Zach Nussbaum
24765a1965 fix: add epoch train 2023-03-27 16:32:35 +00:00
Zach Nussbaum
bb28929305 fix: eos conditional, watermark 2023-03-27 16:29:43 +00:00
Zach Nussbaum
10db136a88 fix: clean, print num rows 2023-03-27 16:27:11 +00:00
Zach Nussbaum
dfee6963a1 fix: don't rewrite clean file if exists! 2023-03-26 18:15:22 +00:00
Zach Nussbaum
eac7734cbf fix: add eos 2023-03-26 17:45:31 +00:00
Zach Nussbaum
2daecd6066 feat: update embeddings 2023-03-26 17:45:21 +00:00
Zach Nussbaum
2ac939529d fix: update to how to train 2023-03-25 21:57:01 +00:00
Zach Nussbaum
134d566b79 feat: base llama 2023-03-25 21:45:58 +00:00
Zach Nussbaum
147260097b fix: don't print token ids of output 2023-03-25 17:18:07 +00:00
Zach Nussbaum
cb43f53f7a fix: map eos,bos hopefully stops 2023-03-25 17:16:22 +00:00
Zach Nussbaum
f51c5c8109 fix: cutoff prompt correctly 2023-03-25 16:48:05 +00:00
Zach Nussbaum
b6e3ba07c4 feat: generation works 2023-03-25 16:43:27 +00:00
Zach Nussbaum
897d818cdb feat: peft submodule 2023-03-25 16:23:14 +00:00
Zach Nussbaum
723a50bdf1 feat: train and clean data 2023-03-25 16:17:48 +00:00
Zach Nussbaum
2568d94e50 feat: env for conda, pip 2023-03-25 16:16:40 +00:00
Zach Nussbaum
e8d5ad9fc2 feat: transformers submodule, gitignore 2023-03-25 16:16:11 +00:00
Ubuntu
4f5c513e71 first commit 2023-03-25 16:05:45 +00:00