Awesome-Mirrors/awesome-stable-diffusion
1
0
Fork 0
mirror of https://github.com/awesome-stable-diffusion/awesome-stable-diffusion.git synced 2024-10-01 05:45:39 -04:00
Code Issues Packages Projects Releases Wiki Activity
Curated list of awesome resources for the Stable Diffusion AI Model.
172 Commits 1 Branch 0 Tags 290 KiB
8038bcb454
Go to file
Georg Zoeller 8038bcb454
Update README.md 
Signed-off-by: Georg Zoeller <georgzoeller@users.noreply.github.com>
2022-10-21 11:52:37 +08:00
.github Update PULL_REQUEST_TEMPLATE.md 2022-08-29 03:22:22 +08:00
LICENSE Initial commit 2022-08-29 01:09:34 +08:00
README.md Update README.md 2022-10-21 11:52:37 +08:00

README.md

Awesome Stable-Diffusion

Awesome

This is a list of software and resources for the Stable Diffusion AI model.

  • 🖊️ marks content that requires sign-up or account creation for a third party service outside GitHub.
  • 💵 marks Non-Free content: commercial content that may require any kind of payment.

Due to the fast-moving nature of the topic, entries in the list may be removed at an expedited rate until the ecosystem matures.

See Contributing.

Official Resources

  • CompVis/Stable Diffusion - The official release of Stable Diffusion including a CLI, an AI-based Safety Classifier, which detects and suppresses sexualized content, and all the necessary files to get running.
  • stability-AI/stability-sdk - The official SDK used to build python applications integrated with StabilityAI's cloud platform instead of hosting the model locally. Operation requires an API Key (🖊️💵).
  • Public Release Announcement - StabilityAI's announcement about the public release of Stable Diffusion.
  • 🖊️ Official Discord - The official Stable Diffusion Discord by StabilityAI.
  • laion-aesthetic - The dataset used train stable diffusion, useful for querying to see if a concept is represented.

Actively Maintained Forks and Containers

All forks listed here add additional features and optimisations and are generally faster than the original release, as they keep the model in memory rather than reloading it after every prompt. Most forks seem to remove the Safety Classifier which may present a risk if used to provide public-facing services, such as Discord bots.

Checkpoints and Weights

Checkpoints (.ckpt files) must be separately downloaded and are required to run Stable Diffusion. The latest model release is v1.5 released by runwayml. The latest stability ai release is 1.4.

need.

  • 🖊️ sd-v1-5 from RunwayML - Stable Diffusion 1.5 Checkpoint released by runwayML, featuring improved inpainting performance.
  • 🖊️ Official Model Card - Official Stability AI Model Card on Hugging Face with all versions of the model. Download requires sign-in and acceptance of terms of service.
  • RealESRGAN Models - Download location for the latest RealESRGAN models required to use the upscaling features implemented by many forks. Different models exist for realistic and anime content. Please refer to the fork documentation to identify the ones you

Online Demos and Notebooks

Complementary Models and Tools

Tools and models for use in conjuction with Stable Diffusion

Img2Img

  • Prompt to Prompt - Unofficial Implementation of Cross-attention-control for prompt to prompt image editing.
  • sd-prompt-graph - This is a React-based curve editor GUI for prompt interpolation animations made with Stable Diffusion.

Customisation

GUIS

Most of these GUIS, unless mentioned otherwise in their documentation, include stable-diffusion.

  • AUTOMATIC1111/stable-diffusion-webui - Gradio based UI with extensive features such as in and outpainting, previews, xy plots, upscaling, clip-interrogation, textual inversion, negative prompting, a variety of upscaling features, checkpoint merging and switching capabilities and more. Comes with a handy install script that takes care of most dependencies and addons.
    • Addon: txt2Mask - Addon for mask based inpainting using natural language instead of brush tools.
  • 🖊️💵 Auto SD Workflow - A UI for lstein/stable-diffusion's dream.py with optimized UX for large-scale/production workflow around image synthesis. Video Walkthrough.
  • cmdr2/stable-diffusion-ui - Another, simple to use UI for windows and Linux.
  • DiffusionBee - Self contained binary app for MacOS.
  • 🖊️ DiffusionUI - web UI made with Vue.js inspired by Dall-e using diffusers, perfect for inpainting. Video demo
  • 🖊️ KIRI.ART (formerly SD-MUI) - mobile-first PWA with multiple models (incl. waifu diffusion). Run free locally or use free & paid credits on the live site. Built with React + MaterialUI. (Source Code) MIT License TypeScript
  • 💵 NMKD GUI - Windows UI, fully featured. Closed source. Pick your own price.
  • sd-webui/stable-diffusion-webui - Very active fork with optional, highly featureful Gradio UI and support for txt2img, img2img inpainting, GFPGAN, ESRGAN, weighted prompts, optimized low memory version, optional textual-inversion and more.
  • Stable Diffusion GRisk GUI - Windows GUI binary for SD. Closed source so use at your own risk.
  • Stable Diffusion Infinity - A proof of concept for outpainting with an infinite canvas interface. (requires powerful GPU).
  • Unstable Fusion - A Stable Diffusion desktop frontend with inpainting, img2img and more
  • stable-diffusion-webui-docker - A docker based frontend integrating the most popular forks.

Upscaling

  • BasicSR - Open-source upscaling and restoration toolbox supporting several models.
  • BSRGAN - BSRGAN—another upscaling solution specialized in upscaling degraded images.
  • Cupscale - GUI for running various upscaling models, including ESRGAN and RealESRGAN.
  • RealESRGAN - ESRGAN Upscaling (2x, 4x) and content restoration. Python: pip install realesrgan
  • jquesnelle/txt2imghd - A port of the GOBIG mode from progrockdiffusion, providing high quality upscaling on top of txt2img.
  • Upscale Wiki Model Database - Wiki and model database for checkpoints compatible with ESRGAN et al.

Content Restoration

  • lama-cleaner - Content aware AI inpainting tool useful for removing unwanted objects or defects from images. Python: pip install lama-cleaner
  • GFPGAN - Face Restoration GAN included in several forks for automatically fixing the face deformation commonly found in SD output.
  • CodeFormer - Another Face Restoration model (Paper).

Task Chaining

  • chaiNNer - Graphical node-based editor for chaining image processing tasks.
  • ai-art-generator - AI art generation suite combining Stable Diffusion and other models for high volume art generation.
  • dfserver distributed backend AI pipeline server for building self-hosted distributed GPU cluster to run the Stable Diffusion and various AI image or prompt building model.

Prompt Building

Prompts are the instructions given to diffusion models to manipulate their output.

  • ai-art.com/modifiers - A visual reference guide for keywords.
  • krea.ai - Prompt search engine that also recommends similar prompts to the one that you click on.
    • 🖊️ With account creation, you can like and save prompts in your own collections.
  • Lexica.art - A searchable, visual database of images and the prompts settings used to create them.
  • pharmapsychotic/clip-interrogator - Jupyter notebook uses CLIP models to suggest a prompt for images similar to a given image (Demo).
  • 🖊️Phraser - A visual prompt builder drawing on a database of examples. (Requires account creation)
  • 🖊️Prompthero = Another visual prompt builder and reference library.
  • PromptoMania - A visual prompt construction tool.
  • rom1504/clip-retrieval - Searches for prompt keywords in the datasets used in training Stable Diffusion and other models (Online GUI).
  • Stable Diffusion Prompt Generator - Gives suggestions for improving a given text prompt.
  • PromptSearch - Yet another Stable Diffusion search engine but with public API
  • Same Energy - A visual search engine that returns images that have the same 'energy'.
  • PublicPrompts - Collection of PublicPrompts

Specialized Usecases

  • dream-textures - A blender addon leveraging stable diffusion for texture creation.
  • stable-dreamfusion - An open source implementation of Google's text-to-3D dreamfusion paper with imagegen replaced by stable diffusion.

Tutorials and Comparisons

Tutorials and high quality educational resources

Getting Up and Running

Learning and Mastering

Studies

Extending Functionality

Community Resources

  • 1 week of Stable Diffusion - A curated list of Stable Diffusion services, adaptations, user interfaces and integrations.
  • pharmapsychotic.com/tools - A curated list of Tools and Resources for AI Art, including but not limited to Stable Diffusion.
  • Stable Diffusion Resources - A thorough resource for answering pressing questions about Stable Diffusion, including guides, tutorials, and best software.

Social Media

Plugins for third party apps

Commercial SaaS and apps implementing Stable Diffusion

  • 🖊️💵 AI Art Generator (IOS) - iOS App to generate art using Stable Diffusion.
  • 🖊️💵 Barium.ai - Generate PBR (physics based rendering) textures from text. Free and paid plans.
  • 🖊️💵 Canva text-to-image - Text-to-image (beta) service from Canva
  • 🖊️💵 Dream Studio - Online art generation service by StabilityAI, the creators of Stable Diffusion. Similar to services like DALL-E or Midjourney, this operates on a credit model with a free allowance of credits given to signed up users on a monthly basis.
  • 🖊️💵 dream.ai - Online art generation service by Wombo.ai (mobile apps available).
  • 🖊️💵 Image Computer - Easy-to-use service aimed at non-technical people (comes with free trial credits)
  • 🖊️💵 Neural.love - Another online art generator with generous free credits as of Oct 2022.
  • 🖊️💵 replicate.com stable diffusion - Another SaaS offering for Stable Diffusion.
  • 🖊️💵 Starry AI (IOS) - Another IOS app offering stable diffusion with preset art styles.
  • 🖊️ Stable Horde - Distributed stable diffusion cluster (think folding@home) with web, discord and telegram interfaces where joining with your GPU gives you priority.
  • 🖊️💵 Stable Diffusion as API - Third party REST API into table Diffusion service.