40 Commits

Author	SHA1	Message	Date
Zach Nussbaum	e550e4ed34	feat: commits for eval + generation	2023-04-11 19:14:29 +00:00
Zach	311c818934	feat: evals on new gptj models	2023-04-10 02:14:20 +00:00
Zach Nussbaum	7807a80bbb	fix: bs try one more time?	2023-04-08 21:47:07 +00:00
Zach Nussbaum	2f0eba211d	fix: smaller bs for 40gb	2023-04-08 21:36:20 +00:00
Zach Nussbaum	7f95ab3a06	fix: config for lora gptj	2023-04-08 21:17:12 +00:00
Zach Nussbaum	c82ee7d882	fix: add wd + min lr to config	2023-04-08 20:37:51 +00:00
Zach Nussbaum	b66f127ade	fix: config + ignore pkl	2023-04-08 20:33:02 +00:00
zanussbaum	147c2fd7eb	feat: lora gptj	2023-04-07 17:53:07 -04:00
zanussbaum	2b001e8932	fix: batch size	2023-04-07 17:41:45 -04:00
zanussbaum	7cfda6a21f	feat: update for mosaic	2023-04-07 16:54:29 -04:00
Zach	fb9ff9c40d	feat: inference for embedding plots	2023-04-07 01:40:39 +00:00
Zach	5baead45be	fix: configs	2023-04-05 20:42:35 +00:00
Zach Nussbaum	0a3834d086	fix: gptj multinode	2023-04-05 02:52:44 +00:00
Zach Nussbaum	df2d5f7e46	feat: gpt-j config	2023-04-04 20:58:08 +00:00
Zach Nussbaum	5c5f41ba36	fix: clean up data, pad at end	2023-04-04 20:53:23 +00:00
Zach Nussbaum	c5f5882d46	Update generate_large_2.yaml	2023-03-28 21:03:10 -07:00
Zach Nussbaum	7427369183	Update generate_large_3.yaml	2023-03-28 21:02:58 -07:00
Zach Nussbaum	0cbac6666d	Update generate_full.yaml	2023-03-28 21:02:32 -07:00
Zach Nussbaum	313fe40dd4	Update generate_baseline.yaml	2023-03-28 21:00:57 -07:00
Zach Nussbaum	cee591e3a8	Update generate.yaml	2023-03-28 21:00:36 -07:00
Zach Nussbaum	07798cfbd2	Update finetune_lora.yaml	2023-03-28 20:58:33 -07:00
Zach Nussbaum	fdb15fc8f1	Update finetune.yaml	2023-03-28 20:58:03 -07:00
Zach Nussbaum	b4ce98591e	Update generate.yaml	2023-03-28 13:59:26 -07:00
bstadt	d55df6b254	Merge branch 'main' of https://github.com/nomic-ai/gpt4all into main	2023-03-28 20:23:42 +00:00
bstadt	37cc5c8c39	updated eval	2023-03-28 20:22:48 +00:00
Zach Nussbaum	0ffa901db8	Update generate_llama.yaml ... fix: paths	2023-03-28 13:08:56 -07:00
Zach Nussbaum	74c7a53df2	Update generate.yaml ... update paths	2023-03-28 13:08:29 -07:00
bstadt	6d98aef302	added eval code	2023-03-28 18:47:38 +00:00
bstadt	4e8e7e7300	metrics run on configs now	2023-03-28 00:09:47 +00:00
bstadt	d5769d7614	removed swp	2023-03-27 22:00:09 +00:00
bstadt	444871189d	added eval configs	2023-03-27 21:59:40 +00:00
bstadt	b48a52d934	started eval script and added eval data	2023-03-27 21:50:08 +00:00
Zach Nussbaum	29cb9d700a	Merge branch 'train' of github.com:nomic-ai/gpt4all into train	2023-03-27 17:39:39 +00:00
Zach Nussbaum	f2e122ff82	fix: add prompt	2023-03-27 17:39:29 +00:00
Zach Nussbaum	ed08006053	feat: lora config	2023-03-27 17:33:13 +00:00
Zach Nussbaum	80227dc164	feat: full model config	2023-03-27 17:30:57 +00:00
Zach Nussbaum	2daecd6066	feat: update embeddings	2023-03-26 17:45:21 +00:00
Zach Nussbaum	134d566b79	feat: base llama	2023-03-25 21:45:58 +00:00
Zach Nussbaum	b6e3ba07c4	feat: generation works	2023-03-25 16:43:27 +00:00
Zach Nussbaum	723a50bdf1	feat: train and clean data	2023-03-25 16:17:48 +00:00