ControlNet support #149
monstruosoft
started this conversation in
General
ControlNet support
#149
Replies: 3 comments 1 reply
-
|
Ipadapter is lightweight and better |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
Gonna take a look into it. |
Beta Was this translation helpful? Give feedback.
0 replies
-
|
I'm looking at IP-Adapter; the adapter models are indeed smaller, but doesn't it also require loading the 2.5 GB image_encoder model?. |
Beta Was this translation helpful? Give feedback.
1 reply
-
|
yes to encode image, IP adpater uses a decoupled cross-attention mechanism so we need to get image features. |
Beta Was this translation helpful? Give feedback.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Much like LoRA, ControlNet is supported natively by the diffusers library, so it should be possible to add ControlNet support to FastSD CPU.
Beta Was this translation helpful? Give feedback.
All reactions