mirror of
https://github.com/nomic-ai/gpt4all.git
synced 2024-10-01 01:06:10 -04:00
17 lines
367 B
Markdown
17 lines
367 B
Markdown
|
# Inference on Training Data
|
||
|
|
|
||
|
|
|
||
|
|
## Run Inference
|
||
|
|
|
||
|
|
```bash
|
||
|
|
torchrun --master_port=29085 --nproc-per-node 8 inference.py --config=configs/inference/gptj.yaml
|
||
|
|
```
|
||
|
|
|
||
|
|
|
||
|
|
## Visualizations
|
||
|
|
|
||
|
|
```bash
|
||
|
|
python build_map.py
|
||
|
|
```
|
||
|
|
|
||
|
|
will build a map in `Atlas`, one using the internal clustering algorithm provided by Nomic and one using the embeddings generated by the finetuned model.
|