266 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
James Ravenscroft	77cde95cb9	remove deprecated cuda dockerfiles	2023-08-26 14:17:31 +01:00
James Ravenscroft	bea7ebdb34	correct runtime libs for openblas and clblast	2023-08-26 14:16:39 +01:00
James Ravenscroft	812bbea9d7	correct typo with clblast	2023-08-26 13:53:26 +01:00
James Ravenscroft	08e8834390	add changes to dockerfile	2023-08-26 13:51:50 +01:00
James Ravenscroft	25680e64d8	remove all the quotes	2023-08-26 13:43:33 +01:00
James Ravenscroft	dca25d8456	remove quotes	2023-08-26 13:42:11 +01:00
James Ravenscroft	1f6f84a783	add quotes to args	2023-08-26 13:39:02 +01:00
James Ravenscroft	0183b30502	always use ubuntu 22.04	2023-08-26 13:32:01 +01:00
James Ravenscroft	b465eae818	break out vars	2023-08-26 13:28:08 +01:00
James Ravenscroft	e8adff5339	try again	2023-08-26 13:22:09 +01:00
James Ravenscroft	f12dacaa15	read the readme properly	2023-08-26 13:16:34 +01:00
James Ravenscroft	0b0b914f92	add commas?	2023-08-26 13:12:27 +01:00
James Ravenscroft	b21dd0799d	fix basenames	2023-08-26 13:10:23 +01:00
James Ravenscroft	c73c196364	build nvidia with default dockerfile	2023-08-26 13:08:19 +01:00
James Ravenscroft	30834e3121	remove brew update to prevent python breaking build	2023-08-26 12:58:02 +01:00
James Ravenscroft	39c3182a3a	try to fix build args	2023-08-26 12:57:00 +01:00
James Ravenscroft	2abdcabf02	use lists for build args	2023-08-26 12:45:23 +01:00
James Ravenscroft	6877542ad8	blas docker build	2023-08-26 12:43:52 +01:00
James Ravenscroft	5b561f7b7e	Merge pull request #61 from c01o/patch-1 ... Fix download link on MODELS.md	2023-08-26 12:37:21 +01:00
c01o	e85492d8ba	Fix download link on MODELS.md	2023-08-26 19:16:15 +09:00
James Ravenscroft	f840ea0b73	Merge pull request #60 from nvtienanh/update-dockerfile-default ... Change from alpine to ubuntu in Dockerfile.default	2023-08-26 09:43:24 +01:00
Anh Nguyen	3e37c4bb7c	Update cmake command	2023-08-26 14:27:27 +07:00
Anh Nguyen	20b1460bd8	Using GGML_STATIC	2023-08-26 14:21:18 +07:00
Anh Nguyen	2308b9ae21	Change from alpine to ubuntu in dockerfile.default	2023-08-26 13:21:04 +07:00
James Ravenscroft	c4e57e0aab	Merge pull request #58 from ravenscroftj/feature/model-lock ... WIP: implement locking of model per request	2023-08-25 06:57:05 +01:00
James Ravenscroft	dc81abbc52	Merge branch 'main' into feature/model-lock	2023-08-24 14:58:44 +01:00
James Ravenscroft	ae2d505a2f	use std mutex instead of boost mutex	2023-08-24 14:55:23 +01:00
James Ravenscroft	143155dac3	boost	2023-08-24 14:28:01 +01:00
James Ravenscroft	596c835939	boost	2023-08-24 14:26:40 +01:00
James Ravenscroft	6b0a25cb71	Merge pull request #59 from ravenscroftj/feature/batch-flag ... expose batch size flag to cli	2023-08-24 14:13:40 +01:00
James Ravenscroft	227501188c	try to set boost librarydir	2023-08-24 13:57:22 +01:00
James Ravenscroft	f69a8f65d4	fix build?	2023-08-24 13:49:14 +01:00
James Ravenscroft	22f2993db4	try using stage lib dir for boost root	2023-08-24 13:28:58 +01:00
James Ravenscroft	e8beac34e7	more attempts to build with boost threads	2023-08-24 13:17:51 +01:00
James Ravenscroft	ccf425f019	update deps for boost	2023-08-24 13:05:10 +01:00
James Ravenscroft	cceee41f79	add boost threads	2023-08-24 13:03:12 +01:00
James Ravenscroft	113544400a	try adding build boost dirs explicitely	2023-08-24 12:04:45 +01:00
James Ravenscroft	f0627cd567	add boost libraries to cmake	2023-08-24 11:50:21 +01:00
James Ravenscroft	2d617b458e	expose batch size flag to cli	2023-08-24 11:40:19 +01:00
James Ravenscroft	0c1fc1a04e	implement locking of model per request to prevent crashing when multiple requests reeived	2023-08-24 11:30:44 +01:00
James Ravenscroft	e0adf0519b	Merge pull request #57 from aperullo/model-docs-fix ... Fix incorrect instructions in model docs	2023-08-24 10:18:36 +01:00
aperullo	ef1402a1a8	Fix errant command in model docs	2023-08-23 17:59:43 -04:00
James Ravenscroft	11f385066a	Merge pull request #54 from ravenscroftj/feature/debug-timing-logs ... Implemented debug log level and added timings to model outputs	2023-08-23 17:17:20 +01:00
James Ravenscroft	6a72e32dab	add debug output to starcoder	2023-08-23 15:53:38 +00:00
James Ravenscroft	bad53ad190	add debug logs to codegen	2023-08-23 14:57:31 +00:00
James Ravenscroft	cd9baacdd7	add debug logs to stablecode	2023-08-23 14:56:36 +00:00
James Ravenscroft	6d90e5d870	Merge pull request #53 from ravenscroftj/feature/expose-temp-top_p ... fix cast problem due to incorrect float notation	2023-08-23 10:42:10 +01:00
James Ravenscroft	88c5ede768	fix cast problem due to incorrect float notation	2023-08-23 08:12:53 +00:00
James Ravenscroft	1e0d2d3434	Merge pull request #52 from ravenscroftj/feature/expose-temp-top_p ... add temp and top p as cli args	2023-08-23 09:03:28 +01:00
James Ravenscroft	757cc64a59	add temp and top p as cli args	2023-08-23 06:27:37 +01:00