Use of "_" and "," to delineate different prompt areas about everydream2trainer

[victorchall]

Underscore has no special meaning if it is in the .txt instead. There's a script in the Every Dream tools repo that will push the filename captions into .txt for you, then you can modify from there. You may wish to modify the script to not use _ to delimit if you want prior to running it.

There's also a very simple GUI editor to edit the .txt files after that.

My understanding is most of the booru taggers are creating .txt files as CSV of tags, so they would work fine with underscores if it is putting them in the .txt or .caption file and not the filename. _ is only reserved in filename captions.

There's no doc for this but its very easy to use:
https://github.com/victorchall/EveryDream/blob/main/scripts/createtxtfromfilename.py

Simple gui mstevenson made:
https://github.com/victorchall/EveryDream/blob/main/doc/CAPTION_GUI.md

For tag shuffling, there's a more complex yaml option with more control but there's no easy way to edit or create them in bulk. Some sort of more "interesting" way to perform data augmentation has been floating around in my head and in the discord community, but it's not entirely obvious what the best approach is. Whatever it is, some meaningful editor is needed.

I'm not sure how to shuffle tags other than to have some sort of delimiter. If you have ideas I'm open. Long term I would like to use a DB (parquest/pandas, etc) to store tags or something I suppose?

Using ".." may create its own problems, there's no good way to use just any string for this without an actual structure to the data that exists outside the actual caption data. For instance, the yaml has structure and doesn't require any reserved characters. Reserved characters in general always cause problems, so I don't feel just changing the reserved character is actually a solution, and just causes problems for other people.

CSV is the current method because its pretty standard for booru tagging to make CSV format outputs. It was specifically added just for booru tag shuffling, and built around that.