53 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Andriy Mulyar	a5c77a9341	Update README.md	2023-03-28 16:09:09 -04:00
Zach Nussbaum	0ffa901db8	Update generate_llama.yaml ... fix: paths	2023-03-28 13:08:56 -07:00
Zach Nussbaum	74c7a53df2	Update generate.yaml ... update paths	2023-03-28 13:08:29 -07:00
Andriy Mulyar	0101532c52	Update README.md	2023-03-28 16:04:18 -04:00
Andriy Mulyar	d6d8f922d8	Update README.md	2023-03-28 15:55:45 -04:00
Andriy Mulyar	1e413231a2	GIF	2023-03-28 15:54:44 -04:00
Andriy Mulyar	972dcb72b6	Update README.md	2023-03-28 15:39:03 -04:00
Andriy Mulyar	094771df53	Update README.md	2023-03-28 15:32:48 -04:00
Andriy Mulyar	a0026ae683	Update README.md	2023-03-28 14:55:22 -04:00
Andriy Mulyar	92f4ecf1b5	Update README.md	2023-03-28 14:52:27 -04:00
Andriy Mulyar	fceba2d67d	Update README.md	2023-03-28 14:50:27 -04:00
Andriy Mulyar	f75a7926aa	Merge pull request #1 from nomic-ai/train ... Latest training details	2023-03-28 14:43:16 -04:00
Andriy Mulyar	cd1f1fe1f4	Update README.md	2023-03-28 14:38:33 -04:00
Andriy Mulyar	d321c6a908	Update README.md	2023-03-28 14:38:18 -04:00
Andriy Mulyar	3f08bf6727	Updated README.md	2023-03-28 12:35:39 -04:00
Andriy Mulyar	975f924ded	Update README.md	2023-03-28 12:26:23 -04:00
Andriy Mulyar	5264da9dda	Update README.md	2023-03-28 12:09:09 -04:00
Andriy Mulyar	82b570be8d	Update README.md	2023-03-28 12:00:25 -04:00
Andriy Mulyar	35965090fa	Update README.md	2023-03-28 11:56:16 -04:00
Zach Nussbaum	c4f96d9bec	feat: training log	2023-03-28 02:49:03 +00:00
Andriy Mulyar	2b47a9d570	Update README.md	2023-03-27 20:46:24 -04:00
Andriy Mulyar	10b39a4cb8	Update README.md	2023-03-27 20:46:14 -04:00
Andriy Mulyar	c389dfb30f	Initial readme update.	2023-03-27 20:20:59 -04:00
bstadt	4e8e7e7300	metrics run on configs now	2023-03-28 00:09:47 +00:00
bstadt	d5769d7614	removed swp	2023-03-27 22:00:09 +00:00
bstadt	444871189d	added eval configs	2023-03-27 21:59:40 +00:00
bstadt	b48a52d934	started eval script and added eval data	2023-03-27 21:50:08 +00:00
Zach Nussbaum	29cb9d700a	Merge branch 'train' of github.com:nomic-ai/gpt4all into train	2023-03-27 17:39:39 +00:00
Zach Nussbaum	f2e122ff82	fix: add prompt	2023-03-27 17:39:29 +00:00
Zach Nussbaum	d87af69a93	fix: add tokens	2023-03-27 17:39:20 +00:00
Zach Nussbaum	ed08006053	feat: lora config	2023-03-27 17:33:13 +00:00
Zach Nussbaum	80227dc164	feat: full model config	2023-03-27 17:30:57 +00:00
Zach Nussbaum	1a95f68494	fix: just read from watermark file	2023-03-27 17:30:44 +00:00
Zach Nussbaum	b369e5a30f	fix: naming	2023-03-27 17:30:33 +00:00
Zach Nussbaum	b24ca03dc4	fix: append first_epoch	2023-03-27 17:30:24 +00:00
Zach Nussbaum	8e22a7276f	chore: gitignore	2023-03-27 16:33:00 +00:00
Zach Nussbaum	24765a1965	fix: add epoch train	2023-03-27 16:32:35 +00:00
Zach Nussbaum	bb28929305	fix: eos conditional, watermark	2023-03-27 16:29:43 +00:00
Zach Nussbaum	10db136a88	fix: clean, print num rows	2023-03-27 16:27:11 +00:00
Zach Nussbaum	dfee6963a1	fix: don't rewrite clean file if exists!	2023-03-26 18:15:22 +00:00
Zach Nussbaum	eac7734cbf	fix: add eos	2023-03-26 17:45:31 +00:00
Zach Nussbaum	2daecd6066	feat: update embeddings	2023-03-26 17:45:21 +00:00
Zach Nussbaum	2ac939529d	fix: update to how to train	2023-03-25 21:57:01 +00:00
Zach Nussbaum	134d566b79	feat: base llama	2023-03-25 21:45:58 +00:00
Zach Nussbaum	147260097b	fix: don't print token ids of output	2023-03-25 17:18:07 +00:00
Zach Nussbaum	cb43f53f7a	fix: map eos,bos hopefully stops	2023-03-25 17:16:22 +00:00
Zach Nussbaum	f51c5c8109	fix: cutoff prompt correctly	2023-03-25 16:48:05 +00:00
Zach Nussbaum	b6e3ba07c4	feat: generation works	2023-03-25 16:43:27 +00:00
Zach Nussbaum	897d818cdb	feat: peft submodule	2023-03-25 16:23:14 +00:00
Zach Nussbaum	723a50bdf1	feat: train and clean data	2023-03-25 16:17:48 +00:00