AI/alpaca-lora
1
0
Fork 0
mirror of https://github.com/tloen/alpaca-lora.git synced 2024-10-01 01:05:56 -04:00
Code Issues Packages Projects Releases Wiki Activity
138 Commits 6 Branches 0 Tags 76 MiB
4606e12494
Commit Graph

30 Commits

Author SHA1 Message Date
Pokai Chang
e2ed209d3b
Support streaming output on generate (#263) 2023-04-04 11:05:20 -04:00
Eric Wang
46f587738c Fix server_name 2023-03-30 08:57:40 -07:00
Chris Alexiuk
4367a43fcb Added Dockerfile and docker-compose.yml (#207) 
* Added Dockerfile for inference

* Added instructions for Dockerfile

* Update README.md

* Update README.md

* Update README.md

* Pass env through Dockerfile

* Added docker compose setup and instructions

* Added more environment options

* Set a safer default mount point

* add docker-compose changes

* Added Dockerfile for inference

* Added instructions for Dockerfile

* Update README.md

* Update README.md

* Update README.md

* Pass env through Dockerfile

* Added docker compose setup and instructions

* Added more environment options

* Set a safer default mount point

* add to gitignore, update to new generate.py

* add docker ignore, simplify docker compose file

* add back missing requirements

* Adjustments to compose and generate.py, added Docker to README.md

* Linting adjust to Black

* Adjusting import linting

* Update README.md

* Update README.md

* Removed comment by original Dockerfile creator.

Comment not necessary.

* cleanup README

Co-authored-by: Francesco Saverio Zuppichini <zuppif@usi.ch>

---------

Co-authored-by: Francesco Saverio Zuppichini <zuppif@usi.ch>
Co-authored-by: Chris Alexiuk <c.s.alexiuk@gmail.com>
Co-authored-by: ElRoberto538 <>
Co-authored-by: Sam Sipe <samsipe@gmail.com>
Co-authored-by: Eric J. Wang <eric.james.wang@gmail.com>
 2023-03-30 08:57:40 -07:00
Angainor Development
8d58d37b65
Templated prompter (#184) 
* Templated prompter

* fix dup import

* Set Verbose False by default

I forgot to disable after testing.

* Fix imports order

* Use Black Formatting

* lint

* Re-introduce lost line

* Cleanup

* template default

* isort

---------

Co-authored-by: Eric Wang <eric.james.wang@gmail.com>
 2023-03-29 19:36:04 -04:00
Jiaxin Shan
4a3c7e2231
Add option to share Gradio demo publicly (#189) 
* Add option to share Gradio demo publicly

* gradio_share -> share_gradio

---------

Co-authored-by: Eric Wang <eric.james.wang@gmail.com>
 2023-03-28 12:43:29 -04:00
Eric Wang
804d22ad43 remove asserts 2023-03-28 08:33:47 -07:00
claysauruswrecks
1310547f9f
Add HF dataset loading, add linters, pyproject.toml (#175) 
* add HF dataset loading, add linters, pyproject.toml

- applied markdownlint
- add black, black[jupyter], isort
- fix noqa codes
- add .github workflow linting
- update README.md

* restore default settings

* resume_from_checkpoint

Co-authored-by: AngainorDev <54739135+AngainorDev@users.noreply.github.com>

* Print warning on checkpoint not found

* add HF dataset loading, add linters, pyproject.toml

- applied markdownlint
- add black, black[jupyter], isort
- fix noqa codes
- add .github workflow linting
- update README.md

* Default to local copy and update it

* Typo

* Remove duplicate code block

---------

Co-authored-by: Eric Wang <eric.james.wang@gmail.com>
Co-authored-by: AngainorDev <54739135+AngainorDev@users.noreply.github.com>
 2023-03-27 13:31:44 -04:00
Eric J. Wang
5fa807d106
Use CLI arguments (#159) 
* CLI args for finetune

* Update README

* CLI args for generate.py

* reqs.txt

* reorder hyperparams

* lora_target_modules

* cleanup
 2023-03-24 17:18:42 -04:00
Eric Wang
72aabcb5a4 Remove LLaMA download code, as a precaution 2023-03-23 13:54:39 -07:00
Eric Wang
8955a9c5a1 bos, eos in generate.py 2023-03-23 13:44:45 -07:00
Eric Wang
e04897baae fix fp16 inference 2023-03-21 14:31:30 -07:00
Eric Wang
997f6cd81f slider for tokens generated 2023-03-19 15:53:21 -07:00
Eric J. Wang
d66908c0ca
Remove messy test code 2023-03-19 11:22:02 -07:00
Eric Wang
c83e30ab78 generate.py tweaks 2023-03-18 23:00:18 -07:00
Eric Wang
80fd9833db don't share publicly 2023-03-18 16:43:53 -07:00
Eric Wang
cb046d647e min beams = 1 2023-03-17 15:07:08 -07:00
Peter Marelas
db4af6a7ff
Enable inference on CPU and Mac GPU using pytorch support for MPS (#48) 2023-03-17 13:53:21 -07:00
Lian Junhong
3a47bd18e8
Update generate.py 
Adapting to the input function, a text box for inputting content has been added.
 2023-03-17 10:30:27 +08:00
Eric Wang
c39da83e2b add Gradio interface to generate.py 2023-03-16 16:04:06 -07:00
Eric Wang
5f6614e6fc Catch outdated installs 2023-03-16 12:11:47 -07:00
andreas.echavez
1862976b33 Update alpaca-lora to use transformers main branch 2023-03-16 12:11:29 -07:00
Eric Wang
c3d94707ec Expand sampling in generate.py for new test 2023-03-16 09:59:10 -07:00
Eric Wang
b8c32be806 Add counting test 2023-03-16 00:05:32 -07:00
Eric Wang
d68ff15ceb generate.py memory, perf updates 2023-03-15 17:22:22 -07:00
Eric Wang
07f5b68e0f torch.no_grad 2023-03-15 11:11:26 -07:00
Eric Wang
6149706680 add text-davinci-003 to comparisons 2023-03-14 21:41:02 -07:00
Eric Wang
d714a73e8c Update README.md with new checkpoint details 2023-03-14 21:33:12 -07:00
Eric Wang
46ddd2ca85 Ready to go 2023-03-14 15:10:33 -07:00
Eric Wang
357ec81a17 decapoda 2023-03-13 17:23:29 -07:00
Eric Wang
63121244c8 Licenses and whatnot 2023-03-13 15:00:05 -07:00