mirror of
https://github.com/nomic-ai/gpt4all.git
synced 2024-10-01 01:06:10 -04:00
add model + data revisions
This commit is contained in:
parent
bc1395da6c
commit
f031d3f1b2
18
README.md
18
README.md
@ -78,6 +78,24 @@ Please see [GPT4All-J Technical Report](https://static.nomic.ai/gpt4all/2023_GPT
|
|||||||
- [Atlas Map of Prompts](https://atlas.nomic.ai/map/gpt4all-j-prompts-curated)
|
- [Atlas Map of Prompts](https://atlas.nomic.ai/map/gpt4all-j-prompts-curated)
|
||||||
- [Atlas Map of Responses](https://atlas.nomic.ai/map/gpt4all-j-response-curated)
|
- [Atlas Map of Responses](https://atlas.nomic.ai/map/gpt4all-j-response-curated)
|
||||||
|
|
||||||
|
We have released updated versions of our `GPT4All-J` model and training data.
|
||||||
|
|
||||||
|
- `v1.0`: The original model trained on the v1.0 dataset
|
||||||
|
- `v1.1-breezy`: Trained on afiltered dataset where we removed all instances of AI language model
|
||||||
|
- `v1.2-jazzy`: Trained on a filtered dataset where we also removed instances like I'm sorry, I can't answer... and AI language model
|
||||||
|
|
||||||
|
The [models](https://huggingface.co/nomic-ai/gpt4all-j) and [data](https://huggingface.co/datasets/nomic-ai/gpt4all-j-prompt-generations) versions can be specified by passing a `revision` argument.
|
||||||
|
|
||||||
|
For example, to load the `v1.2-jazzy` model and dataset, run:
|
||||||
|
|
||||||
|
```python
|
||||||
|
from datasets import load_dataset
|
||||||
|
from transformers import AutoModelForCausalLM
|
||||||
|
|
||||||
|
dataset = load_dataset("nomic-ai/gpt4all-j-prompt-generations", revision="v1.2-jazzy")
|
||||||
|
model = AutoModelForCausalLM.from_pretrained("nomic-ai/gpt4all-j-prompt-generations", revision="v1.2-jazzy")
|
||||||
|
```
|
||||||
|
|
||||||
### GPT4All-J Training Instructions
|
### GPT4All-J Training Instructions
|
||||||
|
|
||||||
```bash
|
```bash
|
||||||
|
Loading…
Reference in New Issue
Block a user