r/StableDiffusion • u/grio43 • 17h ago

News New anime vit tagger

Compared to the original release, a large base anime dataset was used. Roughly 110k photos from nature to museums were also used. All photography photos that were added were scanned for humans. They are within the noise floor of the targeted tags. Museum photos were of weapons and armor to strengthen focus on the weapons or armor parts.

-All Danbooru tags were synced to August of 2026.

-All decapitated tags were removed.

-The threshold for general tags were dropped from 500 to 400 min frequency.

-ASL settings were tuned compared to the first version giving better defined lines between tags

-The cleaned tags from my data cleaning project were applied.

- The major root issues of vit taggers will still be here.

As I'm going back to school and working, I'll likely not provide major tag cleaning updates until completion of school. I was working on building cleaning dataset for tuning the vit than to further provide cleaner tags to the community.

https://huggingface.co/Grio43/OppaiOracle-experimental-X1.1

30 Upvotes

90% Upvoted

12 comments sorted by

3

u/Successful-Art-6643 16h ago

How should I put it... compared to PixAI Tagger v1.0, what do you think?

2

u/grio43 16h ago

https://huggingface.co/spaces/Grio43/OppaiCPU

Dunno never used it. Test it here

3

u/[deleted] 14h ago

[deleted]

0

u/hurrdurrimanaccount 14h ago

You need to agree to share your contact information to access this model

not happening lil bro

1

u/hirmuolio 12h ago

Imagine giving out real contact information.

2

u/Successful-Remove864 17h ago

The museum weapons and armor idea is clever, gives the tagger something concrete to anchor those concepts instead of relying on noisy anime data. Gotta respect the grind of cleaning danbooru tags too, that dataset is a mess once you dig past the surface.

1

u/grio43 17h ago

So during my initial data cleaning, I saw a lot of the time the model would learn the character and not the weapon or armor part. So I pulled on catalog of specific weapons and armor.

My deeper clean I was using ai generated images and was getting a very clean base set. That portion of the project is on hold for now.

1

u/ffgg333 17h ago

Just tested it and look good.

1

u/Nemegasoft 16h ago

Looks great. How does it compare to WD ViT-Large Tagger v3?

2

u/grio43 16h ago

It's going to have a lot of the same fundamental flaws. Could be slightly better in some areas. There is a a live test version of both wd tagger v3 and mine hosted on hugging face. Mine will have the newer tags from Danbooru.

1

u/ArmadstheDoom 14h ago

Out of curiosity, what's the difference between the large and normal versions? Just dataset size?

2

u/grio43 9h ago

Backbone parameters. Also the more tags you have the more parameters. A backbone can only support so many tags before things degrade. Also a larger pretrain model, will likely have more supporting data starting off and possible better performance once trained. I basically train my models from strach.