Commit Graph

304 Commits

Author SHA1 Message Date
James Ravenscroft
6d9c84f527
Goodnight! 2023-09-30 09:16:58 +01:00
James Ravenscroft
eaeb52fcb0
Merge pull request #67 from ravenscroftj/fix/mac-memory-usage
Temporary fix for stablecode and starcoder on mac
2023-08-28 11:55:55 +01:00
James Ravenscroft
83cb7c042f Temporary fix for stablecode and starcoder on mac 2023-08-28 09:50:40 +02:00
James Ravenscroft
8fd357e0a5
Merge pull request #65 from ravenscroftj/ravenscroftj-patch-1
Update README.md
2023-08-26 17:11:21 +01:00
James Ravenscroft
30c437700a
Update README.md 2023-08-26 17:11:12 +01:00
James Ravenscroft
86f07745bb
Merge pull request #64 from ravenscroftj/fix/docker-release
fix docker build for tags
2023-08-26 17:02:05 +01:00
James Ravenscroft
7bb93b6f4e fix docker build for tags 2023-08-26 17:01:35 +01:00
James Ravenscroft
2b27760a7f
Merge pull request #55 from ravenscroftj/feature/gpu_layers
WIP: Integrate more direct GPU support
2023-08-26 16:35:52 +01:00
James Ravenscroft
a00de2a332 recomment the cuda preprocessor check 2023-08-26 16:21:42 +01:00
James Ravenscroft
215a69b5af update clblast code in gpt-j model 2023-08-26 16:16:01 +01:00
James Ravenscroft
91639b8fc0 disable clblast docker images 2023-08-26 16:12:50 +01:00
James Ravenscroft
0b408510f4 add gpu offload for gpt-j models (codegen) 2023-08-26 16:11:16 +01:00
James Ravenscroft
604183380d tidy up prints in stablecoder and starcoder 2023-08-26 16:04:41 +01:00
James Ravenscroft
88683abe50 update run script to incorporate GPU layers 2023-08-26 16:03:16 +01:00
James Ravenscroft
326e76c9bb Merge branch 'main' into feature/gpu_layers 2023-08-26 15:59:13 +01:00
James Ravenscroft
23c0a3d19e Merge branch 'feature/gpu_layers' of github.com:ravenscroftj/turbopilot into feature/gpu_layers 2023-08-26 15:34:28 +01:00
James Ravenscroft
31bb33c731 use latest upstream ggml instead of mine 2023-08-26 15:34:15 +01:00
James Ravenscroft
d4989b543c
Merge pull request #62 from ravenscroftj/feature/blasdocker
Implement better docker builds
2023-08-26 15:32:13 +01:00
James Ravenscroft
e9dc6a304a use latest upstream ggml instead of mine 2023-08-26 15:22:14 +01:00
James Ravenscroft
97a0377cd6 remove llama.cpp submodule 2023-08-26 15:21:01 +01:00
James Ravenscroft
6d26c9b064 Merge branch 'feature/gpu_layers' of github.com:ravenscroftj/turbopilot into feature/gpu_layers 2023-08-26 15:20:25 +01:00
James Ravenscroft
63b554793d tidy cmakelist 2023-08-26 15:20:02 +01:00
James Ravenscroft
0cf7a9c341 remove llama 2023-08-26 15:19:51 +01:00
James Ravenscroft
356a83c5fd remove crow submodule 2023-08-26 15:19:17 +01:00
James Ravenscroft
a5517b0fcd use ggerganov ggml instead of mine 2023-08-26 15:19:04 +01:00
James Ravenscroft
8fa70e1518 update for gpu build 2023-08-26 15:14:18 +01:00
James Ravenscroft
b79ab46b50 add gpu offload for gptneox 2023-08-26 15:14:02 +01:00
James Ravenscroft
4a47251822 update for gpu build 2023-08-26 15:13:08 +01:00
James Ravenscroft
b2b4a1480f increase scratch on starcoder 2023-08-26 15:12:41 +01:00
James Ravenscroft
5f7155a314 add gpu offload for gptneox 2023-08-26 15:12:41 +01:00
James Ravenscroft
77cde95cb9 remove deprecated cuda dockerfiles 2023-08-26 14:17:31 +01:00
James Ravenscroft
bea7ebdb34 correct runtime libs for openblas and clblast 2023-08-26 14:16:39 +01:00
James Ravenscroft
812bbea9d7 correct typo with clblast 2023-08-26 13:53:26 +01:00
James Ravenscroft
08e8834390 add changes to dockerfile 2023-08-26 13:51:50 +01:00
James Ravenscroft
25680e64d8 remove all the quotes 2023-08-26 13:43:33 +01:00
James Ravenscroft
dca25d8456 remove quotes 2023-08-26 13:42:11 +01:00
James Ravenscroft
1f6f84a783 add quotes to args 2023-08-26 13:39:02 +01:00
James Ravenscroft
0183b30502 always use ubuntu 22.04 2023-08-26 13:32:01 +01:00
James Ravenscroft
b465eae818 break out vars 2023-08-26 13:28:08 +01:00
James Ravenscroft
e8adff5339 try again 2023-08-26 13:22:09 +01:00
James Ravenscroft
f12dacaa15 read the readme properly 2023-08-26 13:16:34 +01:00
James Ravenscroft
0b0b914f92 add commas? 2023-08-26 13:12:27 +01:00
James Ravenscroft
b21dd0799d fix basenames 2023-08-26 13:10:23 +01:00
James Ravenscroft
c73c196364 build nvidia with default dockerfile 2023-08-26 13:08:19 +01:00
James Ravenscroft
30834e3121 remove brew update to prevent python breaking build 2023-08-26 12:58:02 +01:00
James Ravenscroft
39c3182a3a try to fix build args 2023-08-26 12:57:00 +01:00
James Ravenscroft
2abdcabf02 use lists for build args 2023-08-26 12:45:23 +01:00
James Ravenscroft
6877542ad8 blas docker build 2023-08-26 12:43:52 +01:00
James Ravenscroft
5b561f7b7e
Merge pull request #61 from c01o/patch-1
Fix download link on MODELS.md
2023-08-26 12:37:21 +01:00
c01o
e85492d8ba
Fix download link on MODELS.md 2023-08-26 19:16:15 +09:00