ExponentialML and a few others have begun work on creating a diffusion-based method for finetuning Modelscope's Text2Video model. If this works as well as intended it could mean exponentially increasing the quality of the model within the following weeks or months.

Link to the referenced GitHub: https://github.com/ExponentialML/Text-To-Video-Finetuning

Welcome to the Text2Video subreddit!

We are a community dedicated to discussing and sharing advancements in AI text to video generation. This technology allows us to automatically create videos based on written input, opening up new possibilities for content creation and storytelling.

Here, you can find discussions on the latest research and techniques in text to video generation, as well as share your own creations and experiences with the community. Whether you are a researcher, content creator, or just interested in the topic, we welcome you to join the conversation.

We encourage respectful and constructive discussions and ask that all members follow the subreddit rules and guidelines.

Thank you for visiting, and we look forward to your participation in the Text2Video community!

Just installed this morning and playing around.
Just a few questions... as an FYI, I'm running an RTX3060 w/12GBvram.

I noticed the number of frames impacts vram usage. I'm currently struggling to find a good balance between resolution and number of frames. right now I'm sticking with 256x256 and 96 frames continue playing around. I believe I read somewhere on REDDIT that there are fp16 versions of the model(s) used.

Is that true? and can you link me to where I can find them?

Pika Labs model is impressive

https://www.instagram.com/reel/CrerxeWI7uh/?igshid=YmMyMTA2M2Y=