James Ravenscroft
|
2d617b458e
|
expose batch size flag to cli
|
2023-08-24 11:40:19 +01:00 |
|
James Ravenscroft
|
e0adf0519b
|
Merge pull request #57 from aperullo/model-docs-fix
Fix incorrect instructions in model docs
|
2023-08-24 10:18:36 +01:00 |
|
aperullo
|
ef1402a1a8
|
Fix errant command in model docs
|
2023-08-23 17:59:43 -04:00 |
|
James Ravenscroft
|
11f385066a
|
Merge pull request #54 from ravenscroftj/feature/debug-timing-logs
Implemented debug log level and added timings to model outputs
|
2023-08-23 17:17:20 +01:00 |
|
James Ravenscroft
|
6a72e32dab
|
add debug output to starcoder
|
2023-08-23 15:53:38 +00:00 |
|
James Ravenscroft
|
bad53ad190
|
add debug logs to codegen
|
2023-08-23 14:57:31 +00:00 |
|
James Ravenscroft
|
cd9baacdd7
|
add debug logs to stablecode
|
2023-08-23 14:56:36 +00:00 |
|
James Ravenscroft
|
6d90e5d870
|
Merge pull request #53 from ravenscroftj/feature/expose-temp-top_p
fix cast problem due to incorrect float notation
|
2023-08-23 10:42:10 +01:00 |
|
James Ravenscroft
|
88c5ede768
|
fix cast problem due to incorrect float notation
|
2023-08-23 08:12:53 +00:00 |
|
James Ravenscroft
|
1e0d2d3434
|
Merge pull request #52 from ravenscroftj/feature/expose-temp-top_p
add temp and top p as cli args
|
2023-08-23 09:03:28 +01:00 |
|
James Ravenscroft
|
757cc64a59
|
add temp and top p as cli args
|
2023-08-23 06:27:37 +01:00 |
|
James Ravenscroft
|
8be7171573
|
Merge pull request #48 from ravenscroftj/fix/docker-static-builds
add check for GGML_STATIC and compile accordingly
|
2023-08-13 09:51:45 +01:00 |
|
James Ravenscroft
|
2f0e2dee94
|
add check for GGML_STATIC and compile accordingly
|
2023-08-13 08:34:07 +01:00 |
|
James Ravenscroft
|
c0cde10046
|
Merge pull request #44 from ravenscroftj/feature/hf-code
Feature/hf code
|
2023-08-10 10:08:20 +01:00 |
|
James Ravenscroft
|
12a3fe9367
|
Merge remote-tracking branch 'origin/main' into feature/hf-code
|
2023-08-10 09:35:22 +01:00 |
|
James Ravenscroft
|
de68ab022c
|
Merge pull request #43 from ravenscroftj/feature/gptneox
Feature/gptneox
|
2023-08-10 09:34:54 +01:00 |
|
James Ravenscroft
|
f7f1991e2c
|
add huggingface request handler and refactor old req handler
|
2023-08-10 09:26:54 +01:00 |
|
James Ravenscroft
|
6ee2d3dc66
|
update readme
|
2023-08-10 08:57:19 +01:00 |
|
James Ravenscroft
|
18faa3e5f6
|
update readme with stablecode refs
|
2023-08-10 08:54:16 +01:00 |
|
James Ravenscroft
|
84869ff0f3
|
added support for gptneox models
|
2023-08-10 08:39:14 +01:00 |
|
James Ravenscroft
|
d618fb1aec
|
update link to 2b multi codegen
|
2023-08-05 12:10:21 +01:00 |
|
James Ravenscroft
|
66270d3a9b
|
Merge pull request #39 from ravenscroftj/fix/build
add .exe
|
2023-08-05 10:09:59 +01:00 |
|
James Ravenscroft
|
c7b4fcddba
|
add .exe
|
2023-08-05 10:09:05 +01:00 |
|
James Ravenscroft
|
14050e15ba
|
Merge pull request #38 from ravenscroftj/fix/build
Fix/build
|
2023-08-05 10:02:59 +01:00 |
|
James Ravenscroft
|
815ae3a088
|
fix windows release
|
2023-08-05 10:02:06 +01:00 |
|
James Ravenscroft
|
5e8773f366
|
don't build arm with cuda during release
|
2023-08-05 09:59:28 +01:00 |
|
James Ravenscroft
|
b14f275bf6
|
Merge pull request #37 from ravenscroftj/refactor/project_structure
Refactor/project structure
|
2023-08-05 09:40:37 +01:00 |
|
James Ravenscroft
|
225faefd2c
|
change readme to 0.1.0
|
2023-08-05 09:23:08 +01:00 |
|
James Ravenscroft
|
7266451f44
|
update build instructions
|
2023-08-05 09:22:15 +01:00 |
|
James Ravenscroft
|
57ab06d457
|
update docs
|
2023-08-05 09:21:06 +01:00 |
|
James Ravenscroft
|
430733c7b8
|
sort out args
|
2023-08-05 08:29:18 +01:00 |
|
James Ravenscroft
|
f5c0bbcb3f
|
add some data folders to ignore
|
2023-08-05 08:28:51 +01:00 |
|
James Ravenscroft
|
506694db16
|
update docker builds
|
2023-08-05 08:01:40 +01:00 |
|
James Ravenscroft
|
0f949020c1
|
update server header
|
2023-08-04 22:50:34 +01:00 |
|
James Ravenscroft
|
c48cd786ed
|
replace crow submodule with header-only impl
|
2023-08-04 22:48:11 +01:00 |
|
James Ravenscroft
|
21b3fa5415
|
limit cuda to 64 bit amd for now
|
2023-08-04 22:33:54 +01:00 |
|
James Ravenscroft
|
b3a4feea81
|
limit cuda to 64 bit amd for now
|
2023-08-04 22:32:48 +01:00 |
|
James Ravenscroft
|
7dee51782d
|
tidy up arm args
|
2023-08-04 22:18:30 +01:00 |
|
James Ravenscroft
|
00ec442860
|
try to move arm options to top level
|
2023-08-04 07:14:38 +01:00 |
|
James Ravenscroft
|
3f3bff73b6
|
add processor specific flags for arm
|
2023-08-04 07:05:20 +01:00 |
|
James Ravenscroft
|
0e17c13f86
|
update paths in docker files
|
2023-07-29 15:49:43 +01:00 |
|
James Ravenscroft
|
a679a63677
|
correct paths for some of the binaries
|
2023-07-29 15:48:45 +01:00 |
|
James Ravenscroft
|
2874e534ef
|
add dependency on asio
|
2023-07-29 15:44:56 +01:00 |
|
James Ravenscroft
|
b0a01071d6
|
update builds for new layout of project
|
2023-07-29 15:42:15 +01:00 |
|
James Ravenscroft
|
dfa4b5e74f
|
add starcoder/wizardcoder/santacoder support
|
2023-07-29 15:28:07 +01:00 |
|
James Ravenscroft
|
7eb10b225e
|
remove weird server.hpp stuff
|
2023-07-23 20:17:40 +01:00 |
|
James Ravenscroft
|
fd3a127aaa
|
add server component
|
2023-07-23 17:50:53 +01:00 |
|
James Ravenscroft
|
887d348188
|
add new code
|
2023-07-23 17:06:44 +01:00 |
|
James Ravenscroft
|
392b212304
|
add spdlog to cmakelists
|
2023-07-23 15:27:36 +01:00 |
|
James Ravenscroft
|
20784a9210
|
add spdlog for logging
|
2023-07-23 15:26:43 +01:00 |
|