AI正在发生 未来正在更新animatediff-motion-adapter-v1-5-3
AnimateDiff is a method that allows you to create videos using pre-existing Stable Diffusion Text to Image models. It achieves this by inserting motion module layers into a frozen text to image model and training it on video clips to extract a motion prior. These motion modules are applied after the ResNet and Attention blocks in the Stable Diffusion UNet. Their purpose is to introduce coherent motion across image frames. To support these modules we introduce the concepts of a MotionAdapter and UNetMotionModel. These serve as a convenient way to use these motion modules with existing Stable Diffusion models. The following example demonstrates how you can utilize the motion modules with an existing Stable Diffusion text to image model.
译文尚未就绪，显示来源原文
AnimateDiff is a method that allows you to create videos using pre-existing Stable Diffusion Text to Image models. It achieves this by inserting motion module layers into a frozen text to image model and training it on video clips to extract a motion prior. These motion modules are applied after the ResNet and Attention blocks in the Stable Diffusion UNet. Their purpose is to introduce coherent motion across image frames. To support these modules we introduce the concepts of a MotionAdapter and UNetMotionModel. These serve as a convenient way to use these motion modules with existing Stable Diffusion models. The following example demonstrates how you can utilize the motion modules with an existing Stable Diffusion text to image model.