6 Commits

Author	SHA1	Message	Date
Lily	630d1146c8	Update export_hf_checkpoint.py (#302) ... * Update export_hf_checkpoint.py * Update finetune.py New tokenizer base model for the current dev branch of transformers * Update generate.py * Update export_state_dict_checkpoint.py * Update export_hf_checkpoint.py	2023-04-09 14:07:59 -07:00
Eric Wang	804d22ad43	remove asserts	2023-03-28 08:33:47 -07:00
claysauruswrecks	1310547f9f	Add HF dataset loading, add linters, pyproject.toml (#175) ... * add HF dataset loading, add linters, pyproject.toml - applied markdownlint - add black, black[jupyter], isort - fix noqa codes - add .github workflow linting - update README.md * restore default settings * resume_from_checkpoint Co-authored-by: AngainorDev <54739135+AngainorDev@users.noreply.github.com> * Print warning on checkpoint not found * add HF dataset loading, add linters, pyproject.toml - applied markdownlint - add black, black[jupyter], isort - fix noqa codes - add .github workflow linting - update README.md * Default to local copy and update it * Typo * Remove duplicate code block --------- Co-authored-by: Eric Wang <eric.james.wang@gmail.com> Co-authored-by: AngainorDev <54739135+AngainorDev@users.noreply.github.com>	2023-03-27 13:31:44 -04:00
Eric Wang	72aabcb5a4	Remove LLaMA download code, as a precaution	2023-03-23 13:54:39 -07:00
Eric Wang	6ced8d9907	fix HF export script	2023-03-18 16:42:58 -07:00
Eric Wang	3b160d745b	HF export script	2023-03-17 17:56:10 -07:00