Fumo Diffusion
Introduction
There are some models of fumos floating around the net at the time I write this, but we did not see anyone taking it serious enough.
The goal of the project is to create a model that allows for versatile creation of fumofumo dolls, including deka fumo.
Ideally, with it you should be able to:
- Mash various ideas into fumo. Like Batman Fumo or Joker Fumo, or even blue-haired catboy in a wedding dress.
- Do authentic touhou characters fumos as well
- Be able to place fumo in various situations, including different lighting, places.
Traditionally, we train with EveryDream, which is a finetune trainer. This is not a dreambooth.
Examples
Imgur Albums with examples:
Usage
Use "fumofumo" in the prompt.
Everything else is up to you.
You can do things like
- Hakurei Reimu fumofumo sitting by a tree in a part
- Batman fumofumo
- Joker fumofumo
- Jeff Besos fumofumo
- fumofumo, catgirl, maid dress, blue hair
Additionally trained prompts:
stock photo, cropped, blurry, noisy, headgear, mob cap
News
12/20/2022
- Alpha v1 Release. Trained on heavily stock photo packed captioned subset of scraped fumo pictures, mainly from My Figure Collection. 80 photos, micro config on everydream.
Some character are better after merged.
Since fumodiffusion-alpha-v1.ckpt model is trained on SD 1.5 vae, note two things:
- Loading additional vae is unnecessary
- SD 1.5 is quite limited by default in what characters in recognizes, especially in anime. You might want to merge it with something. A lot of examples above were done using this recipe:
fumodiffusion-alpha-v1.ckpt + novelai-pruned.ckpt merge at 0.45 weighted sum
Downloads
2.0GB fumodiffusion-alpha-v1.ckpt
By Waifu Science Team
