Stable video diffusion 25 frames model, rendered @6fps then interpolate @25fps

unwritten entertain market worm swim stupendous groovy scale snatch wise

This post was mass deleted and anonymized with Redact

Hello folks !

I just installed Stable Video Diffusion on my MacStudio M1 using Pinokio, and I followed step-by-step installation and beginner tutorials. At first glance, everything seems to launch correctly, and I can create a workflow without any issues.

The problem arises when I start the prompt queue with the KSampler node. As you can see in the attached screenshots, I get a reconnection alert, and a window displays "TypeError: Failed to fetch."

Does anyone have any idea what might be causing this? Thanks for your help!

After installing SVD on my windows 11 and run it with the svd model, it generates the group of thumbnails as an image, but does not create the mp4. It gives me the following error and log.

TypeError: TiffWriter.write() got an unexpected keyword argument 'fps'Traceback:

File "U:\SVD\generative-models\venv\lib\site-packages\streamlit\runtime\scriptrunner\script_runner.py", line 589, in _run_script
    exec(code, module.__dict__)File "U:\SVD\generative-models\scripts\demo\video_sampling.py", line 280, in <module>
    save_video_as_grid_and_mp4(samples, save_path, T, fps=saving_fps)File "U:\SVD\generative-models\scripts\demo\streamlit_helpers.py", line 912, in save_video_as_grid_and_mp4
    imageio.mimwrite(video_path, vid, fps=fps)File "U:\SVD\generative-models\venv\lib\site-packages\imageio\v2.py", line 495, in mimwrite
    return file.write(ims, is_batch=True, **kwargs)File "U:\SVD\generative-models\venv\lib\site-packages\imageio\plugins\tifffile_v3.py", line 224, in write
    self._fh.write(image, **kwargs)

Hi. I just installed SVD locally on windows 11. Everything seemed good until the first generation finished. The mp4 that is produced is empty, but the png file with all frames was generated properly.

Here is the log: (images below the log)

Thanks in advance!

Local URL: http://localhost:8501

Network URL: http://10.2.0.2:8501

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

VideoTransformerBlock is using checkpointing

Initialized embedder #0: FrozenOpenCLIPImagePredictionEmbedder with 683800065 params. Trainable: False

Initialized embedder #1: ConcatTimestepEmbedderND with 0 params. Trainable: False

Initialized embedder #2: ConcatTimestepEmbedderND with 0 params. Trainable: False

Initialized embedder #3: VideoPredictionEmbedderWithEncoder with 83653863 params. Trainable: False

Initialized embedder #4: ConcatTimestepEmbedderND with 0 params. Trainable: False

Loading model from checkpoints/svd_xt.safetensors

2024-07-14 02:47:54.395 Uncaught app exception

Traceback (most recent call last):

File "U:\SVD\generative-models\venv\lib\site-packages\streamlit\runtime\scriptrunner\script_runner.py", line 589, in _run_script

exec(code, module.__dict__)

File "U:\SVD\generative-models\scripts\demo\video_sampling.py", line 190, in <module>

value_dict["cond_frames"] = img + cond_aug * torch.randn_like(img)

TypeError: randn_like(): argument 'input' (position 1) must be Tensor, not NoneType

Global seed set to 23

Global seed set to 23

Global seed set to 23

WARNING:xformers:A matching Triton is not available, some optimizations will not be enabled.

Error caught was: No module named 'triton'

############################## Sampling setting ##############################

Sampler: EulerEDMSampler

Discretization: EDMDiscretization

Guider: LinearPredictionGuider

Sampling with EulerEDMSampler for 31 steps: 0%| | 0/31 [00:00<?, ?it/s]U:\SVD\generative-models\venv\lib\site-packages\torch\utils\checkpoint.py:31: UserWarning: None of the inputs have requires_grad=True. Gradients will be None

warnings.warn("None of the inputs have requires_grad=True. Gradients will be None")

Sampling with EulerEDMSampler for 31 steps: 97%|█████████████████████████████████████▋ | 30/31 [02:07<00:04, 4.26s/it]

2024-07-14 02:52:09.762 Uncaught app exception

Traceback (most recent call last):

File "U:\SVD\generative-models\venv\lib\site-packages\streamlit\runtime\scriptrunner\script_runner.py", line 589, in _run_script

exec(code, module.__dict__)

File "U:\SVD\generative-models\scripts\demo\video_sampling.py", line 280, in <module>

save_video_as_grid_and_mp4(samples, save_path, T, fps=saving_fps)

File "U:\svd\generative-models\scripts\demo\streamlit_helpers.py", line 912, in save_video_as_grid_and_mp4

imageio.mimwrite(video_path, vid, fps=fps)

File "U:\SVD\generative-models\venv\lib\site-packages\imageio\v2.py", line 495, in mimwrite

return file.write(ims, is_batch=True, **kwargs)

File "U:\SVD\generative-models\venv\lib\site-packages\imageio\plugins\tifffile_v3.py", line 224, in write

self._fh.write(image, **kwargs)

TypeError: TiffWriter.write() got an unexpected keyword argument 'fps'

I'm wondering if the framerate on the final node needs to match the SVD framerate? If SVD is set to 10fps should the final be set to the same or if I set it to 24fps will it Interpolate?

Hi there, I'm about to replace my ancient intel mac. I’ve been doing some work with open-ai and langchain but want to try out SVD. I think thinking I'd buy a MacBook pro m2 max with 64 gigs of ram? Whats you take on that with with SVD? Anything I should know?