Creating Everything Everywhere Style Animations with Stable Diffusion
Generating stylized animations like those seen in 'Everything Everywhere All At Once' can be achieved using Stable Diffusion with the Deforum extension. The process involves four key steps:
- Install the Deforum extension
- Configure prompt transitions
- Set frame parameters
- Adjust output settings
To begin, install Deforum through the Stable Diffution WebUI extensions tab. After restarting, the interface will include a new Deforum section. Select a base model similar to text-to-image generation.
Deforum operates using JSON-formatted keyframe prompts:
{
"0": "A surreal landscape with floating geometric shapes and vibrant color gradients",
"30": "Abstract human figures composed of flowing liquid metal in a futuristic cityscape",
"60": "Microscopic organisms magnified to planetary scale with bioluminescent details",
"90": "A dreamlike library with books that rewrite themselves as you watch"
}
Each key represents the frame number where the prompt should take efffect. The animation blends between these prompts over the specified frames. Additional style prompts can be added to maintain consistency:
Cyberpunk neon aesthetic, cinematic lighting, hyper-detailed
Key parameters to adjust include:
- Resolution in the 'Run' tab
- Total frames and animation mode (2D/3D) in the 'Keyframes' tab
- Camera movement in the 'Motion' tab
The quality of output depends heavily on the chosen model and prompt engineering. This technique can also be adapted for logo animations and other creative applications.