dabinishere / style-aligned

Official code for "Style Aligned Image Generation via Shared Attention"

Style Aligned Image Generation via Shared Attention

Project Page   Paper

Setup

This code was tested with Python 3.11, Pytorch 2.1 and Diffusers 0.16.

Examples

• See style_aligned_sdxl notebook for generating style aligned images using SDXL.

• See style_aligned_transfer_sdxl notebook for generating images with a style from reference image using SDXL.

• See style_aligned_w_controlnet notebook for generating style aligned and depth conditioned images using SDXL with ControlNet-Depth.

• style_aligned_w_multidiffusion can be used for generating style aligned panoramas using SD V2 with MultiDiffusion.

Demos

Thanks to @yvrjsharma for preparing the demos: style aligned text to image, ControlNet + StyleAligned and MultiDiffusion + StyleAligned

To start a demo locally, simply run

python <demo file name>.py  

and enter the demo in your browser using the provided url.

An online demo of ControlNet + StyleAligned is available here.

TODOs

• Adding demo.
• StyleAligned from an input image.
• Multi-style with MultiDiffusion.
• StyleAligned with DreamBooth

Disclaimer

This is not an officially supported Google product.