217 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
James Ravenscroft	f818e2d09f	add gpu offload for gptneox	2023-08-21 20:03:25 +01:00
James Ravenscroft	8be7171573	Merge pull request #48 from ravenscroftj/fix/docker-static-builds ... add check for GGML_STATIC and compile accordingly	2023-08-13 09:51:45 +01:00
James Ravenscroft	2f0e2dee94	add check for GGML_STATIC and compile accordingly	2023-08-13 08:34:07 +01:00
James Ravenscroft	c0cde10046	Merge pull request #44 from ravenscroftj/feature/hf-code ... Feature/hf code	2023-08-10 10:08:20 +01:00
James Ravenscroft	12a3fe9367	Merge remote-tracking branch 'origin/main' into feature/hf-code	2023-08-10 09:35:22 +01:00
James Ravenscroft	de68ab022c	Merge pull request #43 from ravenscroftj/feature/gptneox ... Feature/gptneox	2023-08-10 09:34:54 +01:00
James Ravenscroft	f7f1991e2c	add huggingface request handler and refactor old req handler	2023-08-10 09:26:54 +01:00
James Ravenscroft	6ee2d3dc66	update readme	2023-08-10 08:57:19 +01:00
James Ravenscroft	18faa3e5f6	update readme with stablecode refs	2023-08-10 08:54:16 +01:00
James Ravenscroft	84869ff0f3	added support for gptneox models	2023-08-10 08:39:14 +01:00
James Ravenscroft	d618fb1aec	update link to 2b multi codegen	2023-08-05 12:10:21 +01:00
James Ravenscroft	66270d3a9b	Merge pull request #39 from ravenscroftj/fix/build ... add .exe	2023-08-05 10:09:59 +01:00
James Ravenscroft	c7b4fcddba	add .exe	2023-08-05 10:09:05 +01:00
James Ravenscroft	14050e15ba	Merge pull request #38 from ravenscroftj/fix/build ... Fix/build	2023-08-05 10:02:59 +01:00
James Ravenscroft	815ae3a088	fix windows release	2023-08-05 10:02:06 +01:00
James Ravenscroft	5e8773f366	don't build arm with cuda during release	2023-08-05 09:59:28 +01:00
James Ravenscroft	b14f275bf6	Merge pull request #37 from ravenscroftj/refactor/project_structure ... Refactor/project structure	2023-08-05 09:40:37 +01:00
James Ravenscroft	225faefd2c	change readme to 0.1.0	2023-08-05 09:23:08 +01:00
James Ravenscroft	7266451f44	update build instructions	2023-08-05 09:22:15 +01:00
James Ravenscroft	57ab06d457	update docs	2023-08-05 09:21:06 +01:00
James Ravenscroft	430733c7b8	sort out args	2023-08-05 08:29:18 +01:00
James Ravenscroft	f5c0bbcb3f	add some data folders to ignore	2023-08-05 08:28:51 +01:00
James Ravenscroft	506694db16	update docker builds	2023-08-05 08:01:40 +01:00
James Ravenscroft	0f949020c1	update server header	2023-08-04 22:50:34 +01:00
James Ravenscroft	c48cd786ed	replace crow submodule with header-only impl	2023-08-04 22:48:11 +01:00
James Ravenscroft	21b3fa5415	limit cuda to 64 bit amd for now	2023-08-04 22:33:54 +01:00
James Ravenscroft	b3a4feea81	limit cuda to 64 bit amd for now	2023-08-04 22:32:48 +01:00
James Ravenscroft	7dee51782d	tidy up arm args	2023-08-04 22:18:30 +01:00
James Ravenscroft	00ec442860	try to move arm options to top level	2023-08-04 07:14:38 +01:00
James Ravenscroft	3f3bff73b6	add processor specific flags for arm	2023-08-04 07:05:20 +01:00
James Ravenscroft	0e17c13f86	update paths in docker files	2023-07-29 15:49:43 +01:00
James Ravenscroft	a679a63677	correct paths for some of the binaries	2023-07-29 15:48:45 +01:00
James Ravenscroft	2874e534ef	add dependency on asio	2023-07-29 15:44:56 +01:00
James Ravenscroft	b0a01071d6	update builds for new layout of project	2023-07-29 15:42:15 +01:00
James Ravenscroft	dfa4b5e74f	add starcoder/wizardcoder/santacoder support	2023-07-29 15:28:07 +01:00
James Ravenscroft	7eb10b225e	remove weird server.hpp stuff	2023-07-23 20:17:40 +01:00
James Ravenscroft	fd3a127aaa	add server component	2023-07-23 17:50:53 +01:00
James Ravenscroft	887d348188	add new code	2023-07-23 17:06:44 +01:00
James Ravenscroft	392b212304	add spdlog to cmakelists	2023-07-23 15:27:36 +01:00
James Ravenscroft	20784a9210	add spdlog for logging	2023-07-23 15:26:43 +01:00
James Ravenscroft	6e01cd9825	start moving submodules around	2023-07-23 08:07:40 +01:00
James Ravenscroft	90c2310516	Merge pull request #30 from ravenscroftj/release/0.0.5 ... Release/0.0.5	2023-06-13 22:39:40 +01:00
James Ravenscroft	1f8a7fd9cd	add matrix build to windows zips	2023-06-13 22:13:18 +01:00
James Ravenscroft	017b1b72aa	correct windows bit	2023-06-13 22:01:33 +01:00
James Ravenscroft	4c3bee1160	correct build processes	2023-06-13 21:52:49 +01:00
James Ravenscroft	7d5988acbd	try again	2023-06-13 21:45:06 +01:00
James Ravenscroft	480e94a4b1	convert slashes instead of using old action	2023-06-13 21:38:58 +01:00
James Ravenscroft	d48be56a8f	revert gh release action for windows compat	2023-06-13 21:30:39 +01:00
James Ravenscroft	a24234f1dd	test	2023-06-13 21:23:53 +01:00
James Ravenscroft	0f8ccb9659	test	2023-06-13 21:22:46 +01:00