Skip to content

Instantly share code, notes, and snippets.

@harubaru
Last active July 21, 2024 14:03
Show Gist options
  • Save harubaru/8581e780a1cf61352a739f2ec2eef09b to your computer and use it in GitHub Desktop.
Save harubaru/8581e780a1cf61352a739f2ec2eef09b to your computer and use it in GitHub Desktop.

image

masterpiece, best quality, 1girl, green hair, sweater, looking at viewer, upper body, beanie, outdoors, watercolor, night, turtleneck

Waifu Diffusion 1.4 Anime Release Notes

Download Pages

Table of Contents

Model Overview

The Waifu Diffusion 1.4 Anime model is a Stable Diffusion v2 model that has been finetuned from Stable Diffusion v2.1 Base.

The data used for finetuning Waifu Diffusion 1.4 Anime was 5,468,025 text-image samples that had been downloaded through an image board that provides high-quality tagging and original sources to the artworks themselves that are uploaded to the site.

Within the HuggingFace Waifu Diffusion 1.4 Repository are various models used within the production of the model:

Prompting

During dataset processing, the following quality modifiers were added to samples depending on the score of the post:

Quality Modifier Score Criterion
masterpiece >150
best quality 100-150
high quality 75-100
medium quality 25-75
low quality -5-0
worst quality <-5

Additionally, certain metadata were also added in the form of rating modifiers.

Rating Modifiers Criterion
safe Samples that are safe for work.
questionable Samples that include risque visuals which are probably not safe for work.
nsfw Sexually explicit or graphic material that you should not view while your boss is looking over your shoulder.
deleted Samples that were marked for deletion.

Based off of the above modifiers, an ideal negative prompt to guide the model towards high aesthetic generations would look like:

worst quality, low quality, medium quality, deleted, lowres, comic, bad anatomy, bad hands, text, error, missing fingers, extra digit, fewer digits, cropped, jpeg artifacts, signature, watermark, username, blurry

And, the following should also be prepended to prompts to get high aesthetic results:

masterpiece, best quality, high quality, absurdres

Sample Generations

image

masterpiece, best quality, 1girl, black eyes, black hair, black sweater, blue background, bob cut, closed mouth, glasses, medium hair, red-framed eyewear, simple background, solo, sweater, upper body, wide-eyed

image

masterpiece, best quality, 1girl, aqua eyes, baseball cap, blonde hair, closed mouth, earrings, green background, hat, hoop earrings, jewelry, looking at viewer, shirt, short hair, simple background, solo, upper body, yellow shirt

image

masterpiece, best quality, 1girl, black bra, black hair, black panties, blush, borrowed character, bra, breasts, cleavage, closed mouth, gradient hair, hair bun, heart, large breasts, lips, looking at viewer, multicolored hair, navel, panties, pointy ears, red hair, short hair, sweat, underwear

image

masterpiece, best quality, high quality, yakumo ran, touhou, 1girl, :d, animal ears, blonde hair, breasts, cowboy shot, extra ears, fox ears, fox shadow puppet, fox tail, head tilt, large breasts, looking at viewer, multiple tails, no headwear, short hair, simple background, smile, solo, tabard, tail, white background, yellow eyes

image

masterpiece, best quality, high quality, scenery, japanese shrine, no humans, absurdres

Team Members and Acknowledgements

This project would not have been possible without the incredible work by StabilityAI. I would also like to personally thank everyone for their generous support in our Discord server! Thank you guys!

In order to reach us, you can join our Discord server.

Discord Server

License

The Waifu Diffusion 1.4 Weights have been released under the CreativeML Open RAIL-M License.

@AlohaJava
Copy link

👍

@fzbuzz
Copy link

fzbuzz commented Jan 3, 2023

👍

@Naugustogi
Copy link

👍

@Fresh-glitch
Copy link

👍

@semjon00
Copy link

semjon00 commented Jan 5, 2023

👍

@GripenANM
Copy link

👍

@Wyti
Copy link

Wyti commented Jan 6, 2023

👍

@Chem1ce
Copy link

Chem1ce commented Jan 9, 2023

👍

@Kotoezhh
Copy link

Kotoezhh commented Jan 9, 2023

👍

@SophiaH67
Copy link

👍

@KatouMegumi-osu
Copy link

Why not add "lossy-lossless" to negative prompt?

@przemoc
Copy link

przemoc commented Jan 17, 2023

Looks like:

has been uploaded yesterday.

Some comparisons with epoch 1:

@sebas-san
Copy link

yes

@AdamFull
Copy link

How to run this model locally?

@Trimad
Copy link

Trimad commented May 9, 2023

nice

@LKADity
Copy link

LKADity commented Jun 2, 2023

👍

@xsfrsg
Copy link

xsfrsg commented Jul 16, 2023

👍

@yingzeliangzi
Copy link

Thank you for your work!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment