AI/gpt4all
1
0
Fork 0
mirror of https://github.com/nomic-ai/gpt4all.git synced 2024-10-01 01:06:10 -04:00
Code Issues Packages Projects Releases Wiki Activity
d59c77ac55
gpt4all/gpt4all-backend/tokenizer
History
Aaron Miller d59c77ac55 buf_ref.into() can be const now
2023-05-30 12:05:57 -04:00
..
bpe.cpp New tokenizer implementation for MPT and GPT-J 2023-05-30 12:05:57 -04:00
bpe.h buf_ref.into() can be const now 2023-05-30 12:05:57 -04:00
gptj_tokenizer_config.h New tokenizer implementation for MPT and GPT-J 2023-05-30 12:05:57 -04:00
mpt_tokenizer_config.h New tokenizer implementation for MPT and GPT-J 2023-05-30 12:05:57 -04:00