Commit Graph

176 Commits

Author SHA1 Message Date
Zach
5baead45be fix: configs 2023-04-05 20:42:35 +00:00
Zach
a57adb0344 fix: try except push 2023-04-05 20:42:22 +00:00
Zach Nussbaum
399a65e779 feat: multinode setup 2023-04-05 02:53:04 +00:00
Zach Nussbaum
0a3834d086 fix: gptj multinode 2023-04-05 02:52:44 +00:00
Zach Nussbaum
fde7d9506f fix: ignore env 2023-04-05 02:52:21 +00:00
Zach Nussbaum
97d4499d79 fix: only on first process, not once on every node 2023-04-05 02:36:22 +00:00
Zach Nussbaum
d0402288bd fix: eval func 2023-04-04 23:25:37 +00:00
Zach
65ec606f21 fix: prompt len for larger 2023-04-04 22:01:55 +00:00
Zach Nussbaum
df2d5f7e46 feat: gpt-j config 2023-04-04 20:58:08 +00:00
Zach Nussbaum
3efc19ebc5 feat: adamw, fix training, log gradients 2023-04-04 20:57:42 +00:00
Zach Nussbaum
5c5f41ba36 fix: clean up data, pad at end 2023-04-04 20:53:23 +00:00
Zach Nussbaum
2e2e9f4339 fix: clean where prompt is randomly 1 char 2023-04-04 20:47:21 +00:00
Zach Nussbaum
2e3e35c7a2 chore: gitignore ckpts 2023-04-04 20:46:57 +00:00
Andriy Mulyar
252676ff05
Merge pull request #3 from nomic-ai/train
log wandb multi-epoch
2023-03-29 13:50:26 -04:00
Andriy Mulyar
aa4dd0eaef
Qualified number of epochs for LoRa weights 2023-03-29 12:26:47 -04:00
Andriy Mulyar
b10890f8f9
Merge pull request #42 from tiendung/main
Change git clone url to https://github.com/nomic-ai/gpt4all.git to avoid `Permission denied`
2023-03-29 10:50:44 -04:00
Andriy Mulyar
c197eee060
Added Torrent Magnet Link 2023-03-29 10:47:19 -04:00
Andriy Mulyar
8e5511896c
Merge pull request #36 from Hello1024/patch-1
Update README.md to add torrent link to data
2023-03-29 10:38:26 -04:00
Andriy Mulyar
753c6baf96
Merge branch 'main' into patch-1 2023-03-29 10:38:17 -04:00
Andriy Mulyar
220df0924f
Merge pull request #31 from EliasVincent/chat-windows-binary
Add chat binary for Windows
2023-03-29 10:35:38 -04:00
Andriy Mulyar
f5d46e8182
Merge branch 'main' into chat-windows-binary 2023-03-29 10:35:31 -04:00
Andriy Mulyar
e2c59517f2
Merge pull request #26 from dsernst/mac-intel-bin
Add binary for Intel Macs
2023-03-29 10:34:52 -04:00
Alex Nguyen
88841bdf0f
Change git clone url to https://github.com/nomic-ai/gpt4all.git
git@github.com:nomic-ai/gpt4all.git yield `Permission denied`

```sh
git clone --recurse-submodules git@github.com:nomic-ai/gpt4all.git

Cloning into 'gpt4all'...
git@github.com: Permission denied (publickey).
fatal: Could not read from remote repository.
```
2023-03-29 20:59:13 +07:00
Andriy Mulyar
4e20fdfbb9
Changed hosting 2023-03-29 09:55:18 -04:00
Hello1024
284cd9d480
Update README.md to add torrent link to data 2023-03-29 13:49:32 +01:00
EliasVincent
2c5d4a3a32 Add chat binary for Windows 2023-03-29 12:48:13 +02:00
David Ernst
546c2c8aaa Add binary for Intel Macs 2023-03-29 03:18:23 -05:00
Zach Nussbaum
7e468f2199
Update data.py 2023-03-28 21:13:05 -07:00
Zach Nussbaum
c5f5882d46
Update generate_large_2.yaml 2023-03-28 21:03:10 -07:00
Zach Nussbaum
7427369183
Update generate_large_3.yaml 2023-03-28 21:02:58 -07:00
Zach Nussbaum
0cbac6666d
Update generate_full.yaml 2023-03-28 21:02:32 -07:00
Zach Nussbaum
313fe40dd4
Update generate_baseline.yaml 2023-03-28 21:00:57 -07:00
Zach Nussbaum
cee591e3a8
Update generate.yaml 2023-03-28 21:00:36 -07:00
Zach Nussbaum
07798cfbd2
Update finetune_lora.yaml 2023-03-28 20:58:33 -07:00
Zach Nussbaum
fdb15fc8f1
Update finetune.yaml 2023-03-28 20:58:03 -07:00
Andriy Mulyar
4120210d9d
Merge pull request #16 from mazzzystar/main
To make the model bin file more clear in README.
2023-03-28 22:43:03 -04:00
mazzzystar
819475e232 to make the model bin file more clear. 2023-03-29 10:29:19 +08:00
Brandon Duderstadt
710c8f9fde
Update README.md 2023-03-28 21:07:04 -04:00
Brandon Duderstadt
43819a87d5
Merge pull request #9 from Daryl149/main
fix typo in generate example command
2023-03-28 20:43:09 -04:00
Daryl
712a3cc2b1 fix typo in generate example command 2023-03-29 02:40:34 +02:00
Brandon Duderstadt
c96ee798f3
Merge pull request #7 from nlothian/patch-1
Fix run command in README. Fixes #6
2023-03-28 20:30:16 -04:00
Nick Lothian
be6e99f344
Correct run command
The executable seem to expect the model to be in the working directory
2023-03-29 10:42:49 +10:30
Brandon Duderstadt
0789956e55
Update README.md
added discord link
2023-03-28 20:11:08 -04:00
Zach Nussbaum
7e597f7da8
Update README.md 2023-03-28 14:31:35 -07:00
Andriy Mulyar
bc130fb13b
Update README.md 2023-03-28 17:25:06 -04:00
Andriy Mulyar
aa17ac7591
Update README.md 2023-03-28 17:24:46 -04:00
Brandon Duderstadt
e4379c3a77
Update README.md 2023-03-28 17:22:11 -04:00
Andriy Mulyar
6e6bb11cf8
Update README.md 2023-03-28 17:06:53 -04:00
Andriy Mulyar
393e0f951d
Update README.md 2023-03-28 17:06:28 -04:00
Andriy Mulyar
d52c60fb67
Update README.md 2023-03-28 17:05:03 -04:00