gpt4all/gpt4all-training/GPT-J_MAP.md

17 lines
367 B
Markdown
Raw Normal View History

2023-04-10 02:14:20 +00:00
# Inference on Training Data
## Run Inference
```bash
torchrun --master_port=29085 --nproc-per-node 8 inference.py --config=configs/inference/gptj.yaml
```
## Visualizations
```bash
python build_map.py
```
will build a map in `Atlas`, one using the internal clustering algorithm provided by Nomic and one using the embeddings generated by the finetuned model.