Comments (3)
Hey @krrishdholakia,
Great question! We're still very much in the early phases of developing the library, but the goal is to have a library that can be used as a toolbox to quickly try out new architectures, sampling methods and so forth. So in the case of imagen-pytorch, the idea would be that you can soon use this library to try out different sampling methods as well as different model architectures
from diffusers.
Hey @krrishdholakia,
Imagen-PyTorch is actually conceptually quite simple as it's just a cascade of diffusion models and a T5 Text-Encoder. The difficulty is that no pre-trained weights are available yet.
If weights are available you could use any of the available schedulers that we provide:
- https://github.com/huggingface/diffusers/tree/main/src/diffusers/schedulers
and then you could wrap this into a Pipeline with:
https://github.com/huggingface/diffusers/tree/main/src/diffusers/pipelines
from diffusers.
Closing for now, feel free to open again if you have more questions. In general, we as Hugging Face would be more than happy to support efforts to replicate Imagen for the OS community
from diffusers.
Related Issues (20)
- Converting safetensors file with "_pickle.UnpicklingError: invalid load key, ' '." HOT 1
- StableDiffusionUpscaleLDM3DPipeline object has no attribute 'upcast_vae'
- Very Slow first inference with diffusers 0.27.X HOT 5
- Combined loss term for VQ-VAE (`diffusers.VQModel`) HOT 2
- [mps] training / inferencing deepfloyd must be done in float32 HOT 3
- Issue with reproducing ip_adapter_sdxl_controlnet_demo.ipynb example from doc HOT 2
- [deepfloyd] unloading lora weights results in error HOT 2
- Tensor Device mismatch error HOT 1
- Controlnet inpainting change too much of masking area HOT 5
- Bug of PixArtAlphaPipeline HOT 1
- Mismatching size in matmul when using StableDiffusionInstructPix2Pix pipeline with IP-Adapter HOT 3
- A strange time cost in denoising loop HOT 5
- set mixed_precision="fp16",but the model is not fp16 HOT 5
- Support OLSS Scheduler
- Something went wrong HOT 1
- Make the sampling loop of pipelines modular, with designated inputs that can be handled iteratively with functions and a default sampler step function HOT 2
- Feature Request: new release HOT 3
- Inquiry About Using Non-Square Images for ControlNet Training HOT 1
- I feel confused about this TODO issue. how to pass timesteps as tensors? HOT 1
- Multi-controlnet formatting issue HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from diffusers.