gpt4all/gpt4all-training/GPT-J_MAP.md

17 lines
367 B
Markdown
Raw Permalink Normal View History

2023-04-09 22:14:20 -04:00
# Inference on Training Data
## Run Inference
```bash
torchrun --master_port=29085 --nproc-per-node 8 inference.py --config=configs/inference/gptj.yaml
```
## Visualizations
```bash
python build_map.py
```
will build a map in `Atlas`, one using the internal clustering algorithm provided by Nomic and one using the embeddings generated by the finetuned model.