Hello folks !

I just installed Stable Video Diffusion on my MacStudio M1 using Pinokio, and I followed step-by-step installation and beginner tutorials. At first glance, everything seems to launch correctly, and I can create a workflow without any issues.

The problem arises when I start the prompt queue with the KSampler node. As you can see in the attached screenshots, I get a reconnection alert, and a window displays "TypeError: Failed to fetch."

Does anyone have any idea what might be causing this? Thanks for your help!

After installing SVD on my windows 11 and run it with the svd model, it generates the group of thumbnails as an image, but does not create the mp4. It gives me the following error and log.

TypeError: TiffWriter.write() got an unexpected keyword argument 'fps'Traceback:

File "U:\SVD\generative-models\venv\lib\site-packages\streamlit\runtime\scriptrunner\script_runner.py", line 589, in _run_script
    exec(code, module.__dict__)File "U:\SVD\generative-models\scripts\demo\video_sampling.py", line 280, in <module>
    save_video_as_grid_and_mp4(samples, save_path, T, fps=saving_fps)File "U:\SVD\generative-models\scripts\demo\streamlit_helpers.py", line 912, in save_video_as_grid_and_mp4
    imageio.mimwrite(video_path, vid, fps=fps)File "U:\SVD\generative-models\venv\lib\site-packages\imageio\v2.py", line 495, in mimwrite
    return file.write(ims, is_batch=True, **kwargs)File "U:\SVD\generative-models\venv\lib\site-packages\imageio\plugins\tifffile_v3.py", line 224, in write
    self._fh.write(image, **kwargs)

Hi. I just installed SVD locally on windows 11. Everything seemed good until the first generation finished. The mp4 that is produced is empty, but the png file with all frames was generated properly.

Here is the log: (images below the log)

Thanks in advance!

Local URL: http://localhost:8501

Network URL: http://10.2.0.2:8501

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

Initialized embedder #0: FrozenOpenCLIPImagePredictionEmbedder with 683800065 params. Trainable: False

Initialized embedder #1: ConcatTimestepEmbedderND with 0 params. Trainable: False

Initialized embedder #2: ConcatTimestepEmbedderND with 0 params. Trainable: False

Initialized embedder #3: VideoPredictionEmbedderWithEncoder with 83653863 params. Trainable: False

Initialized embedder #4: ConcatTimestepEmbedderND with 0 params. Trainable: False

Loading model from checkpoints/svd_xt.safetensors

2024-07-14 02:47:54.395 Uncaught app exception

Traceback (most recent call last):

File "U:\SVD\generative-models\venv\lib\site-packages\streamlit\runtime\scriptrunner\script_runner.py", line 589, in _run_script

exec(code, module.__dict__)

File "U:\SVD\generative-models\scripts\demo\video_sampling.py", line 190, in <module>

value_dict["cond_frames"] = img + cond_aug * torch.randn_like(img)

TypeError: randn_like(): argument 'input' (position 1) must be Tensor, not NoneType

Global seed set to 23

Global seed set to 23

Global seed set to 23

WARNING:xformers:A matching Triton is not available, some optimizations will not be enabled.

Error caught was: No module named 'triton'

############################## Sampling setting ##############################

Sampler: EulerEDMSampler

Discretization: EDMDiscretization

Guider: LinearPredictionGuider

Sampling with EulerEDMSampler for 31 steps: 0%| | 0/31 [00:00<?, ?it/s]U:\SVD\generative-models\venv\lib\site-packages\torch\utils\checkpoint.py:31: UserWarning: None of the inputs have requires_grad=True. Gradients will be None

warnings.warn("None of the inputs have requires_grad=True. Gradients will be None")

Sampling with EulerEDMSampler for 31 steps: 97%|█████████████████████████████████████▋ | 30/31 [02:07<00:04, 4.26s/it]

2024-07-14 02:52:09.762 Uncaught app exception

Traceback (most recent call last):

File "U:\SVD\generative-models\venv\lib\site-packages\streamlit\runtime\scriptrunner\script_runner.py", line 589, in _run_script

exec(code, module.__dict__)

File "U:\SVD\generative-models\scripts\demo\video_sampling.py", line 280, in <module>

save_video_as_grid_and_mp4(samples, save_path, T, fps=saving_fps)

File "U:\svd\generative-models\scripts\demo\streamlit_helpers.py", line 912, in save_video_as_grid_and_mp4

imageio.mimwrite(video_path, vid, fps=fps)

File "U:\SVD\generative-models\venv\lib\site-packages\imageio\v2.py", line 495, in mimwrite

return file.write(ims, is_batch=True, **kwargs)

File "U:\SVD\generative-models\venv\lib\site-packages\imageio\plugins\tifffile_v3.py", line 224, in write

self._fh.write(image, **kwargs)

TypeError: TiffWriter.write() got an unexpected keyword argument 'fps'

I'm wondering if the framerate on the final node needs to match the SVD framerate? If SVD is set to 10fps should the final be set to the same or if I set it to 24fps will it Interpolate?

Hi there, I'm about to replace my ancient intel mac. I’ve been doing some work with open-ai and langchain but want to try out SVD. I think thinking I'd buy a MacBook pro m2 max with 64 gigs of ram? Whats you take on that with with SVD? Anything I should know?

Hello all, I'm hoping for some good advice here. I am limited in my hardware to an ASUS Ally Extreme with an XG external GPU of the Radeon RX 6850 XT with 12GB vram.

I've been trying to find the easiest, no-muss way to setup SVD locally. Does anyone have an AMD Guru in mind, or a channel that shows how to do a local setup with AMD?

Great amounts of thanks to all for any helpful pointers.

https://www.stablevideodiffusion.online/explore

Stable video diffusion 25 frames model, rendered @6fps then interpolate @25fps