5 Commits

Author	SHA1	Message	Date
Adam Treat	cf8a4dd868	Infinite context window through trimming.	2023-04-25 11:20:51 -04:00
Adam Treat	a79bc4233c	Implement repeat penalty for both llama and gptj in gui.	2023-04-25 08:38:29 -04:00
Adam Treat	55084333a9	Add llama.cpp support for loading llama based models in the gui. We now ... support loading both gptj derived models and llama derived models.	2023-04-20 06:19:09 -04:00
Aaron Miller	f1b87d0b56	Add thread count setting	2023-04-19 08:33:13 -04:00
Adam Treat	9de185488c	Add an abstraction around gpt-j that will allow other arch models to be loaded in ui.	2023-04-13 22:15:40 -04:00