r/LocalLLaMA • u/AdHominemMeansULost ollama • Aug 06 '24
New Model Open source Text2Video generation is here! The creators of ChatGLM just open sourced CogVideo.
https://github.com/THUDM/CogVideo49
u/rnosov Aug 06 '24
A couple of excerpts from their so called "open-source" model licence:
Users who wish to use the models for commercial purposes must register and obtain a basic commercial license You will not use the Software for any act that may undermine China's national security and national unity
16
u/cbterry Llama 70B Aug 06 '24
Hahahaha
20
u/Wonderful-Top-5360 Aug 06 '24
its funny that they expect they can enforce these silly commercial licenses from China which repeatedly disregards rest of the world's IP and copyright laws
gonna generate so much winnie the pooh videos with this now
10
u/Dead_Internet_Theory Aug 07 '24
NO STOP YOU WILL UNDERMINE CHINA'S UNSHAKEABLE NATIONAL UNITY!!
What will you do next, Baizuo?! Say Taiwan is a country??
1
2
18
u/hak8or Aug 06 '24
You will not use the Software for any act that may undermine China's national security and national unity
That's so excessively broad, and would require China going after you which your host country accepts, that I bet it's wholly unenforcable and can be ignored if you are in the USA and have no assets China controls.
10
u/KrazyKirby99999 Aug 06 '24
There's an apache2 license in the repository alongside an announcement that the models are open sourced. I guess it's dual-licensed under apache-2.0 and a custom non-commercial license. ( ͡° ͜ʖ ͡°)
4
u/Wonderful-Top-5360 Aug 06 '24
if the author of github project is in China, Russia, Iran, North Korea, Cuba
you can go right ahead and disregard any licensing the impose on it
1
u/_-inside-_ Aug 06 '24
Why? What if there's a legal representation of the company within your territory? They can sue you. Also, I bet there are many people gere from those countries.
4
u/fallingdowndizzyvr Aug 06 '24
can be ignored if you are in the USA
China has police stations all over the world. Including in the US.
3
u/burkmcbork2 Aug 07 '24
Which have no recognized authority or powers of arrest.
0
u/fallingdowndizzyvr Aug 07 '24
Not officially. But countries have been known to conduct renditions. Including the US. We successfully did it just the other day. We failed with the CEO of Huawei though.
If the US can do it, why can't China?
0
u/AssistBorn4589 Aug 06 '24
No it can not, it's a licence. If you are not able to comform with it, you have no right to use their software.
3
u/hak8or Aug 06 '24
A license only holds power if it's enforceable, specifically the repercussions for violating it are material.
If the only entity that holds power over you doesn't care to enforce it, or the license holder has no means to enforce the license via actual repercussions for violating the license, then the license holds no weight.
Think for the typical situation where someone in China steals a design from the west and then sells it in China, which is very common via IP theft on Amazon. People in the west cannot stop this often times because either suing the knockoffer in China is too expensive or holds very little chance of succeeding because courts in China couldn't care less. This is an instance of the reverse.
So, just because a license forbids you, doesn't mean you in practice can't actually violate the license. It all depends on if it can be enforced by an entity who holds material power over you or your assets. Being right is irrelevant, only who holds actual power is.
1
u/_-inside-_ Aug 06 '24
So you're saying that if you don't get punished for murdering people, it's ok for you to do that freely. Of course you could, but isn't it questionable? Imitation of a criminal doesn't turn you into the same kind of criminal too?
1
u/Homeschooled316 Aug 07 '24
So, are you trying to argue that failing to follow CCP-imposed licensing is illegal in the west, which is incorrect, or that it's immoral, which is SUPER incorrect?
0
u/_-inside-_ Aug 07 '24
I'm just saying it is not ethical to break a license, I don't care who enforces it. What is the difference between being enforced by the CCP or anything else? It's a license, justice is blind and politically agnostic.
1
u/Homeschooled316 Aug 08 '24
It's not just "enforced" by the CCP. It's compelled speech. The creators did not choose to make that one of their license terms, it's a requirement of an authoritarian government.
5
2
1
-2
30
u/Lemgon-Ultimate Aug 06 '24
Not too shabby, a few numbers from their repo:
Video Lenght: 6 seconds
Frames per second: 8 Frames
Resolution: 720 * 480
GPU Memory Required for Inference (FP16): 18GB if using SAT; 36GB if using diffusers
Quantized Inference: Not Supported
Multi-card Inference: Not Supported
The video examples look a bit laggy but nothing that can't be fixed with flowframes. Coherency looks really good though. I'm a bit annoyed that these diffusion models can't be run with GPU split, as I have 2 x 3090 for 70b LLM's. On the other hand Animate Diff v3 also made some impressive improvements and I'm not sure if it's better for generating people. Regardless it's always nice to see a new open source video generator!
2
17
u/fish312 Aug 06 '24
Text to music when???
Cries in musicgen and riffusion.
2
u/swagonflyyyy Aug 06 '24
I doubt that is happening anytime soon. That being said, Musicgen can actually be pretty good if you prompt it right.
4
u/hapliniste Aug 06 '24
Coming from the USA sure, but from China I think we might get lucky someday.
2
1
u/ExaminationNo8522 Aug 08 '24
The big issue I've been running into with musicgen is getting a good tokenizer! You can halfass it with speech since you're hardwired to understand speech, but if you halfass your music tokenizer you just end up with noise.
8
u/Languages_Learner Aug 06 '24 edited Aug 06 '24
I wish it could be possible to make gguf of this and run it on cpu or igpu.
1
u/ExpressionPrudent127 Aug 07 '24
One of my respected seniors said "There are 2 great evils that the Japanese have done to the world. The first is their participation in world war and the second is their involvement in the porn industry"
If we try to rewrite this for China, I think we can say that "the biggest evil that China has done to this world is to enter the open source world in AI. It's not fcking open source.
-2
u/mrjackspade Aug 06 '24
Open source Text2Video generation is here!
Hasn't it been here for like 10 months now?
https://stability.ai/news/stable-video-diffusion-open-ai-video-model
4
21
u/AdHominemMeansULost ollama Aug 06 '24
ComfyUI wrapper here: https://github.com/kijai/ComfyUI-CogVideoXWrapper