GithubHelp home page GithubHelp logo

altryne / awesome-ai-art-image-synthesis Goto Github PK

View Code? Open in Web Editor NEW
1.7K 48.0 120.0 477 KB

A list of awesome tools, ideas, prompt engineering tools, colabs, models, and helpers for the prompt designer playing with aiArt and image synthesis. Covers Dalle2, MidJourney, StableDiffusion, and open source tools.

ai

awesome-ai-art-image-synthesis's Introduction

Awesome AI image synthesis Awesome PRs Welcome Twitter Follow ko-fi

A list of awesome tools, ideas, prompt engineering tools, colabs, models, and helpers for the prompt designer playing with aiArt and image synthesis. Covers Dalle2, MidJourney, StableDiffusion, and open source tools. Many of these tools come with "batteries included" and won't include colabs or python code you have to run. (for colabs see this list)

Contents

Text-to-image Models you can run

Models, commercial and open source, that you can either try for free and pay for credits or can run in the cloud.

Commercial

  • DreamStudio - #StableDiffusion in the cloud
  • Midjourney - Discord bot with amazing visuals
  • Dalle2 - The one that started it all, great with multi characters
  • NightCafe - Nightcafe studio is an AI Art Generator (incrorporates stableDiffusion)
  • ArtBreeder Collage - A collaging tool to generate art using visual aides.
  • Photoroom - Photoroom has a new feature for backgrounds (featured on product hunt)

Free hosted tools

Free local

*Advanced Batteries not included, this section is for advanced folks who can use the command line, install python packages, run code etc'

  • StableDiffusion + Web GUI - This repo has a step by step way to install and run #stableDiffusion using local GPU + a gradio based web UI. Has a nice UI, upscalers built-in, img2img and inpainting, and a LOT more! (see thread with features CleanShot 2022-08-27 at 15 10 34@2x

  • StableDiffusion with Diffusers - A simple-ish way to run stable diffusion locally using hugging face diffusers library

img2img - Generate images from a combination of prompt + init image

img2img refers to the practice of feeding a model an init image AND a prompt.

  • stable-img-to-img - Hosted version of img2img tool from stable diffusion. Provide an image + a prompt
  • Diffuse-The-Rest - A simple Hugging Face img2img tool that allows for image upload and/or simplistic drawing with a prompt

Prompt engineering

The emerging field of the Prompt Engineering is just beginning, and yet there are tools released for us every day. Follow this repo for the best tools as they become "Awesome"

Tools for prompt engineers

  • Lexica - A Stable Diffusion prompts search engine
  • Libraire - Another Stable Diffusion prompts search engine, with over 10M images and prompts
  • Krea.ai - A prompt builder with a nice UI, searchable prompts.
  • PromptMania prompt builder - A prompt builder that supports MJ, SD and Dalle, with visual examples and a lot of modifiers
  • Promptbase Marketplace - Buy and sell your promtps for πŸ’°
  • GPT-2 prompt generator - A GPT2 model trained to autocomplete MJ prompts

Artist/Modifier studies

Browser extensions

Tips and tricks

Inspiration tools

  • same.energy - A visual exploration search engine.
  • CLIP retrieval - Allows you to browse the major datasets the img-2-text models were trained on.

Post processing tools

Resolution upscale - subscription

Resolution upscale - free

  • WebUI repo has upscalers built in!
  • real-esrgan - A hosted version of real-ERSGan with optional face correction
  • Cupscale - Windows app that upscales with ERSGan on your GPU
  • chaiNNer - A flowchart/node-based image processing GUI for Windows, MacOS, and Linux

Fix faces

  • PRs Welcome

Fix hands

  • PRs Welcome

Beutify

  • TBD

Outcrop

  • TBD

Inpaint

  • TBD

Communities

Discord

  • Stable Diffusion discord - A great community with folks who help each other
  • MidJourney - A huge community of image synthesis folks, prompt help, inspiration channels, etc

Reddit

  • r/StableDiffusion - A rapidly growing Subreddit for Stable Diffusion related content - Community Run
  • r/MidJourney - The official subreddit for MidJourney related Content

Theory & Learning

Tutorials

YouTube Video Resources

Twitter Threads

Notable Twitter Accounts

  • Ai, AiArt, Generative - A twitter list of 70+ #aiArt community members, a stream of conciuosness for the field
  • @ClaireSilver12 - Great content, tips and tricks, up to date knowledge about ai synthesis
  • @TomLikesRobots - Deep insight into this new tech, with updates
  • @diffusionBot - A stableDiffusion bot that generates a prompt right in twitter replies when you mention it.
  • Whats AI - Louis Bouchard - Accessible AI concepts, paper reviews, youtube videos

Upcoming exciting projects

🚨 These are some of amazing things folks are working on, and is worth keeping in mind, maybe register to their waiting list or give them a follow

If you find this list valuable

ko-fi

Contribute

Contributions more than welcome! In fact it's why I wrote this list, to get contributions and have folks subscribe to changes to get notified about new and exciting stuff coming to this world of AI art

Read the contribution guidelines first.

Acknowledgements and shoutouts

@pharampsychotic - For the insane tools list on their website, the support in DMs, and the spaces with a lot of patience and answers ❀️

awesome-ai-art-image-synthesis's People

Contributors

altryne avatar ascendedgravity avatar joshuakimsey avatar webel avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

awesome-ai-art-image-synthesis's Issues

BUG: Stable Diffusion WebUI - Error: No usable font found

I tried to use your WebUI for SD via your Colab (https://colab.research.google.com/github/altryne/sd-webui-colab/blob/main/Stable_Diffusion_WebUi_Altryne.ipynb#scrollTo=jnXUwtACCHOy) and got a β€œNo usable font found” error.

Iteration: 1/1
100% 50/50 [00:19<00:00, 2.51it/s]
Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/gradio/routes.py", line 247, in run_predict
output = await app.blocks.process_api(
File "/usr/local/lib/python3.8/site-packages/gradio/blocks.py", line 641, in process_api
predictions, duration = await self.call_function(fn_index, processed_input)
File "/usr/local/lib/python3.8/site-packages/gradio/blocks.py", line 556, in call_function
prediction = await anyio.to_thread.run_sync(
File "/usr/local/lib/python3.8/site-packages/anyio/to_thread.py", line 31, in run_sync
return await get_asynclib().run_sync_in_worker_thread(
File "/usr/local/lib/python3.8/site-packages/anyio/_backends/_asyncio.py", line 937, in run_sync_in_worker_thread
return await future
File "/usr/local/lib/python3.8/site-packages/anyio/_backends/_asyncio.py", line 867, in run
result = context.run(func, *args)
File "scripts/webui.py", line 998, in txt2img
output_images, seed, info, stats = process_images(
File "scripts/webui.py", line 923, in process_images
grid = image_grid(output_images, batch_size)
File "scripts/webui.py", line 419, in image_grid
fnt = get_font(30)
File "scripts/webui.py", line 401, in get_font
raise Exception(f"No usable font found (tried {', '.join(fonts)})")
Exception: No usable font found (tried arial.ttf, DejaVuSans.ttf)

The program is completely unusable. Please fix this. Thank you.

BUG: Img2img no longer works

Stable Diffusion webUI

Traceback (most recent call last):
File "/usr/local/lib/python3.8/site-packages/gradio/routes.py", line 247, in run_predict
output = await app.blocks.process_api(
File "/usr/local/lib/python3.8/site-packages/gradio/blocks.py", line 641, in process_api
predictions, duration = await self.call_function(fn_index, processed_input)
File "/usr/local/lib/python3.8/site-packages/gradio/blocks.py", line 556, in call_function
prediction = await anyio.to_thread.run_sync(
File "/usr/local/lib/python3.8/site-packages/anyio/to_thread.py", line 31, in run_sync
return await get_asynclib().run_sync_in_worker_thread(
File "/usr/local/lib/python3.8/site-packages/anyio/_backends/_asyncio.py", line 937, in run_sync_in_worker_thread
return await future
File "/usr/local/lib/python3.8/site-packages/anyio/_backends/_asyncio.py", line 867, in run
result = context.run(func, *args)
File "scripts/webui.py", line 1288, in img2img
output_images, seed, info, stats = process_images(
File "scripts/webui.py", line 819, in process_images
samples_ddim = func_sample(init_data=init_data, x=x, conditioning=c, unconditional_conditioning=uc, sampler_name=sampler_name)
File "scripts/webui.py", line 1194, in sample
xi = x0 + noise
RuntimeError: The size of tensor a (72) must match the size of tensor b (64) at non-singleton dimension 3

All editing options under img2img do not work. Crop and uncrop throw the above error. Mask returns no image.

Add enstil.ai

Why is it awesome?
It is unlimited and free and you can find prompt inspiration by searching other prompts with output generated.

** Link **
Add a link

Screenshot / Twitter thread raving about this
image

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    πŸ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. πŸ“ŠπŸ“ˆπŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❀️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.