Training Chroma with using diffusion-pipe on linux
Notes
- Eval datasets are the same format as training. Copy 1-4 image/text pairs from your training into eval.
- I put all my configs in the examples folder
- Losses around 0.2-0.4 are normal
Installation
Config
examples/chroma.toml
examples/chromadataset.toml which is the same as examples/evaldataset.toml except the path
Running
NCCL_P2P_DISABLE="1" NCCL_IB_DISABLE="1" deepspeed --num_gpus=1 train.py --deepspeed --config examples/chroma.toml