mirror of
https://github.com/nomic-ai/gpt4all.git
synced 2024-09-19 15:25:53 +00:00
17 lines
367 B
Markdown
17 lines
367 B
Markdown
# Inference on Training Data
|
|
|
|
|
|
## Run Inference
|
|
|
|
```bash
|
|
torchrun --master_port=29085 --nproc-per-node 8 inference.py --config=configs/inference/gptj.yaml
|
|
```
|
|
|
|
|
|
## Visualizations
|
|
|
|
```bash
|
|
python build_map.py
|
|
```
|
|
|
|
will build a map in `Atlas`, one using the internal clustering algorithm provided by Nomic and one using the embeddings generated by the finetuned model. |