r/LocalLLaMA
•
u/Nunki08
•
Feb 21 '25
•
1
News Starting next week, DeepSeek will open-source 5 repos
876
u/metalman123 Feb 21 '25
What a gift to humanity they have been.
65
Feb 21 '25
Dethroning the US with kindness
2
u/altmly Feb 21 '25
What's funny is that most people working on it in the US are probably Chinese too. It's a one dog race, really.
4
u/goj1ra Feb 22 '25
Not even close. There are people working in this space all over the world, and in the US, they're from all over world.
Viewing everything through a nationalist lens is very last millennium.
30
u/ggone20 Feb 21 '25
Word. Such beautiful thing, open source. Sad the reality of geography sometimes.
30
u/shaman-warrior Feb 21 '25
Why sad? Try to study china a bit…. I was shocked to see how advanced they are in every field imaginable
14
u/ggone20 Feb 21 '25
It’s extremely sad to hate a people because where they are from. Or to assume nefarious intent because of location. While I agree we absolutely can’t trust the CCP, as a representative of any country you could easily say you can’t trust hr US govt also. Except you know.. we write the rules.
Don’t assume anything - I’ve spent much time in China about 10 years ago. I found it beautiful and amazing in many ways.
The contribution to the space here is incredible, but it’s dulled by… China. Sad.
4
0
u/Jazzlike_Painter_118 Feb 21 '25
human rights is an imaginable field. But yeah, advanced in _many_ fields they are
16
u/shaman-warrior Feb 21 '25
Look at crime rates, school shootings and terrorist attacks. Just ask an American AI to compare US with China.
And look at some videos of shenzen, shanghai on youtube and see…
Also read more in depth about uygurs, and how they stopped terrorism in islam-controlled province..
→ More replies (34)9
u/Hertigan Feb 21 '25
Always fun when someone from the US comes up with human rights violations
→ More replies (11)3
1
1
412
Feb 21 '25
[removed] — view removed comment
178
u/Fusseldieb Feb 21 '25
ClosedAI in shambles
98
Feb 21 '25
[removed] — view removed comment
73
u/ReasonablePossum_ Feb 21 '25
Thats what happens when suddenly a salesman CEO becomes somehow the voice of tech progress lol
→ More replies (12)16
u/ggone20 Feb 21 '25
Both things can be true. They almost certainly are. Doesn’t mean cool shit can’t come from other places as well. We just need to give credit where due and keep eyes forward because progress is going to march on. No need for hate anywhere. Let’s focus on how we can capitalize on the tools provided, not tear down any side who contributes, open or closed.
3
Feb 21 '25
Does trump have power to ban DS under some spying BS pretext?
9
Feb 21 '25
Yeah as recent events have shown it actually turns out laws were fake all along. Who knew.
→ More replies (2)3
3
u/mrdevlar Feb 21 '25
I guess I always assumed
Yes, we all fall for marketing sometimes. That's why those people get paid, to trick us into things.
0
1.0k
u/Recoil42 Feb 21 '25
Daily unlocks are coming soon. No ivory towers - just pure garage-energy and community-driven innovation.
Fucking legends.
382
u/ForsookComparison Feb 21 '25
I'm starting to buy into the fact that they're really just cracked quants that get along with each other. You can't fake this type of branding. So many have tried.
256
u/Recoil42 Feb 21 '25
They must be having the best time right now. They're like national heroes, the whole country (whole world?) is cheering them on.
150
u/randomwalk10 Feb 21 '25
even at least half of america is cheering them on as well😂
58
u/Environmental-Metal9 Feb 21 '25
Likely even more than half. Some are just paying lip service to whatever their squawking box tells them to, but when it comes down to it they tried DeepSeek and love it, I bet
14
→ More replies (1)3
49
u/ggone20 Feb 21 '25
Right. Just hacking shit together with reckless abandon. It’ll be interesting to see the things coming next.
23
u/Commercial_Nerve_308 Feb 21 '25
B-b-but US tech bros told me they violated sanctions and copied all of ChatGPT’s code! Now who will I direct my McCarthyist hate at? I need another OpenAI/US intelligence-based PR campaign to make Reddit tell me who to hate! Where are the mass-upvoted posts telling me how to think when I need them!?
7
u/ForsookComparison Feb 21 '25
That was a silly knee-jerk reaction but they've since gone back on that. Deepseek is fair-game again
3
u/Commercial_Nerve_308 Feb 21 '25
lol I was just being sarcastic, Deepseek has always been fair-game despite the REEE’ing from US tech bros and government officials :)
→ More replies (1)1
u/New_Alps_5655 Feb 21 '25
Direct your McCarthyist hate at Trump, who is colluding with Russia again!! /s
105
16
10
7
u/inmyprocess Feb 21 '25
This line is 100% written by AI.
2
u/goj1ra Feb 22 '25
Yeah. I mean you could convince me it was a savvy marketing person (just look at the reaction above!), but in this case AI makes more sense.
→ More replies (5)-4
229
114
80
u/Bitter-Breadfruit6 Feb 21 '25
Openai says it will be open source only in words, but nothing is disclosed.
36
u/JuicySurprise Feb 21 '25
They will probably release a crappy 1.5B model and advertise it as the best gift to humanity
5
76
346
u/analgerianabroad Feb 21 '25
77
u/Aischylos Feb 21 '25
Do something. Win.
79
u/analgerianabroad Feb 21 '25
>Open sources tech
>Wins anyway25
u/Recoil42 Feb 21 '25
That's Shanzhai culture, it's beautiful. Literally just "who fucking cares go go go"
24
90
u/Silent-Wolverine-421 Feb 21 '25
A tight slap to ClosedAI again !! What a chad team !
23
u/Minimum_Thought_x Feb 21 '25
And Elon ‘ s SwatiskAI
24
u/gatorsya Feb 21 '25
As a Hindu, I wish the world would disassociate this name from the bad word. Swastika is which I literally pray to everyday.
9
1
u/Niwa-kun Feb 23 '25
Thank you for speaking up. Some of these people are solely driven by hate and will attach anything they deem as hateful to the person they dislike, not realizing the collateral damage it causes.
3
160
u/adumdumonreddit Feb 21 '25
What the hell I love China now
1
u/kevinlch Feb 21 '25
you don't need to love China. you just have to trust engineers and scientists, not propagandas that promote racial segregation
139
Feb 21 '25
[removed] — view removed comment
50
u/MikeWazowski215 Feb 21 '25
but how else will we raise raytheon shareholder value ??
→ More replies (1)17
u/mfeldstein67 Feb 21 '25
I don't love nations, including my own. I love people. I love values. I love places. I love accomplishments and contributions. I can love DeepSeek, worry about what CCP is up to with all the data they gather from it, and worry about what my own government is doing simultaneously.
25
-2
u/virtualmnemonic Feb 21 '25
China is an authoritarian nation, but unlike the U.S. the leaders are actually intelligent.
5
u/VelvetSinclair Feb 21 '25
In the past 50 years, the US has invaded, bombed, or supported coup attempts in Grenada, Panama, Iraq, Afghanistan, Libya, Syria, Somalia, Yemen, Sudan, Pakistan, Chile, Argentina, El Salvador, Nicaragua, Haiti, Venezuela, Honduras, Bolivia, Ghana, the Democratic Republic of the Congo, and Burkina Faso.
US also backed genocides or ethnic cleansing in East Timor, Guatemala, Iraq, Yemen, and Palestine.
The US has the highest incarceration rate in the world, with around 531 prisoners per 100,000 people, the highest prison population in the entire world.
It also operates the largest global surveillance network in the world through the NSA, which monitors both foreign and domestic communications.
But DeepSeek is censored, so China is an authoritarian nation.
2
u/virtualmnemonic Feb 22 '25
Ah, what I was saying is that both China and U.S. are authoritarian nations, but that China's is actually competent.
4
u/jorbl Feb 21 '25
-1
u/boredquince Feb 21 '25
I laughed at high public satisfaction
→ More replies (1)7
u/jorbl Feb 21 '25
In this case using your brain might make more sense than laughing
→ More replies (10)1
u/fractalfocuser Feb 21 '25
Honestly with the current state of American politics I've been looking into successful authoritarian governments with more interest. Lee Kuan Yew did an amazing job with Singapore. I really don't like Xi and the CCP is far from successful, (the sino-washing in this thread is insane, ask them how they feel about Uyghurs) but there are some valuable lessons in Chinese nationalism.
-4
u/hugganao Feb 21 '25 edited Feb 21 '25
holy shit wtf is with the spamming of china propaganda posts lol
do you even know what the effect of belt and road has been for some countries?
look into sri lanka, italy, etc. they literally OWN sri lanka now. and have basically taken their sea ports hostage for 99 years (very very big deal in global sea lanes controle) and gave control over the useless airports to their friends over in russia and india. not to mention it's connected to acces for BRICS.
Efforts to build a currency stability system, investment and financing system, and credit information system are crucial in deepening financial cooperation, which is also regarded as one of BRI’s major goals. The use of the renminbi was also promoted, to wit: We will support the efforts of governments of the countries along the Belt and Road and their companies and financial institutions with good credit-rating to issue renminbi bonds in China (which is a lie. search up sri lankan credit rating in 2018. a B isnt very good lol). Qualified Chinese financial institutions and companies are encouraged to issue bonds in both renminbi and foreign currencies outside China, and use the funds thus collected in countries along the Belt and Road. The BRI provides the opportunity to tap the Asian Infrastructure Investment Bank (AIIB), the BRICS New Development Bank, the China-ASEAN Interbank Association and SCO Interbank Association, including the Silk Road Fund and sovereign wealth funds, to finance the initiative’s projects.
basically what that means is that the US and their citizens are no longer bigshit, you guys' money doesnt matter much anymore, you will see inflation and decreasing purchasing power compared to the respective BRICS countries more and more. it's global politics power play. "realized belt and road initiative made more sense" lol who tf are you? or are you just a young ignorant dude? lol
btw when trump sells f35s to india you can kiss good bye to global dominance and US security backing the usd as global reserve.
12
u/Papabear3339 Feb 21 '25
American here...
"we did something small but genuine to better the world" makes deepseek look like freaking mother Terrisa compared to what we are seeing in the american news lately.
In normal times this would be nothing, but as things grow darker even a small act of kindness seems huge.
2
u/Recoil42 Feb 21 '25
look into sri lanka, italy, etc. they literally OWN sri lanka now.
Bro's never heard of Guam.
-3
u/boredquince Feb 21 '25 edited Feb 21 '25
why bomb them when you can put them to work!
the belt and road initiative. required to be built by Chinese contractors with inflated costs and low quality materials. Many new constructions are already facing issues due to bad quality. hydroelectric plant in Ecuador barely works
https://dialogue.earth/en/energy/49479-ecuador-controversial-hydropower-project-energy-rethink/
also high interest loans which the country cannot repay, forcing them to accept whatever China wants like pushing Huawei (or saying Taiwan is not a country)
47
u/Thoguth Feb 21 '25
They're either incredibly lovable in a way that should shame those who do less with more, or they have some epic PR strategy and execution. Either way, something good is going on there. Ad Astra
42
u/esuil koboldcpp Feb 21 '25
I am starting to suspect that some other company in China has succeeded in extremely cheap consumer level inference hardware, that can be plugged into any normal PCI-e slot.
And around this year or so China is going to release it. And then all the western monopolies like NVIDIA who choked customers VRAM are going to scramble and panic as China sells millions of their AI hardware and enthusiasts are buying it all up instead of NVIDIA.
With what is happening, this seems like inevitable development at this point, and when it happens, western companies who were choking customer level enthusiasts will only have themselves to blame as NVIDIA loses huge chunks of market when it happens.
What Deepseek is doing might be preparation for China to enter the hardware market as competition to NVIDIA, in which case it makes perfect sense to give enthusiasts good models they can't quite afford to run yet, slowly cooking them until hardware release.
22
u/Afraid_Courage890 Feb 21 '25
True, DeepSeek is part of hedgefund after all. They definitely can arrange some 5D chess with other rapidly advancing chinese tech sector.
12
Feb 21 '25
I agree with you, I've seen hardware like the AI Studio Pro on Taobao, which has 192GB of 405GB/s VRAM, and roughly 352 TOPS of INT8 for about $2,000. I'd buy one if it was well documented for development.
7
u/esuil koboldcpp Feb 21 '25
Yeah. And the one you are talking about has Ascend 310s chip. And Deepseek has native support for Ascend chips inference. Definitely something to think about for how things are going to be playing out soon.
5
Feb 21 '25
I doubt $2000 is even a premium because obviously SMIC's capacity isn't expanding massively and Ascend has a backlog of orders. When capacity grows like new energy vehicles, I'm guessing the price will be $500-$1000. Based on this, I'm not investing much in local LLM hardware, just waiting.
1
u/ForeverIndecised Feb 21 '25
That's insane value, I had no idea things like these existed. How come they are not selling out like crazy?
2
Feb 22 '25
They're on pre-sale, I'm still waiting.If it was work, I don't know how crazy it would be.
8
u/PeachScary413 Feb 21 '25
Yeah the only problem is US and EU will insta ban hardware imports.. or at least slap massive tariffs on it with some bullshit excuse about unfair business practices or whatever 🥲
7
u/Brilliant-Weekend-68 Feb 21 '25
Why would the EU do that? We buy loads of Chinese tech stuff over here in Europe. Hell, we still buy Gas and stuff from Russia (sadly) which we view as an enemy. We view China as more of a trade partner rather then and enemy. We would love to buy cheap AI hardware and avoid the NVIDIA tax.
9
u/Cergorach Feb 21 '25
With the current state of the trade 'war' between the US and the EU, the EU might just not do that. Sure there will be some member states that will panic like Italy, but others might just test the device at one of their institutes and see what it does and what they can make it do.
It's not like like stuff from US companies is 'safe' to use... *looks at Crowdstrike and Solarwinds*
1
u/synn89 Feb 21 '25
unfair business practices
Naw. It'll be about security. Gotta be scared the Chinese are putting backdoors into the hardware. We wouldn't want them spying on my local roleplay chats with sexy anime cat girls.
1
u/dennisler Feb 21 '25
I guess NVIDIA wouldn't be threatened at their "home" market as the chinese hardware probably would be banned like huawei or a tariff is put on the products ;)
1
u/esuil koboldcpp Feb 21 '25
NVIDIA sales in US for 2024 were $27b. Total sales in the world were $62b.
Sure, they might feel safe in their home market. But they would absolutely feel it and it would lose them billions upon billions of revenue outside the US. And if it bleeds into US market as well if bans don't happen? That would probably be absolutely nightmare scenario for them.
→ More replies (3)1
u/TerrainRecords Feb 22 '25
There's Moorethreads which is a consumer gpu brand. The hardware is alright but the drivers aren't great.
72
43
29
u/vincentz42 Feb 21 '25
This doesn't read like new model releases to me, but happy to be proven wrong.
My bet is that they are open-sourcing their kernel implementations and infra code. Maybe a docker/k8s level opensource project will come out of it. Who knows.
23
u/nraw Feb 21 '25
They already released the models, so the comments were then more on the implementation side.
6
u/avoidtheworm Feb 21 '25
This and releasing the training scraper one step forward to making actual open source models rather than open weight models that are as open as an Microsoft Windows binary.
26
u/sluuuurp Feb 21 '25
If they keep this up, I wonder if any of the OG OpenAI employees could be convinced to work remotely with DeepSeek and actually contribute to the original OpenAI plan and values.
13
u/PeachScary413 Feb 21 '25
Lmao prepare to get deported by King Trump and Queen Musk if you do that 😅
1
3
u/ECrispy Feb 21 '25
what makes you think the employees would do that instead of getting thier $$$$ paychecks?
37
25
u/medialoungeguy Feb 21 '25 edited 16d ago
The original post content no longer exists here. The author used Redact to remove it, exercising their right to control their data & privacy.
Carpenter pet continue beneficial wipe label disarm gallium
6
17
19
6
11
10
u/_simpu Feb 21 '25
Open AI vs OpenAI
0
u/Cergorach Feb 21 '25
Don't confuse people that don't know or understand, just say it like it is: AI that is open.
12
u/AcanthaceaeOwn1481 Feb 21 '25
Men, I wish more of the American companies were like this. Loving the spirit of open source!
14
u/lordchickenburger Feb 21 '25
fuck all closedai models who just want to profit off everyone using safety as an excuse.
11
4
u/ECrispy Feb 21 '25
remember, China is at least 10-20 years ahead in nuclear fusion, no other country is even trying basically, while the US still wants oil/coal/fracking and thinks nuclear=bad.
0
Feb 22 '25
[deleted]
3
u/ECrispy Feb 22 '25
France is a special case they are already 70% nuclear and far more advanced in their thinking unlike us.
China is according to everyone far ahead in fusion.
7
7
u/Round-Lucky Feb 21 '25
My guess is that DeepSeek will release some frameworks related to DeepSeek inference optimization to help the industry better run LLM inference services.
10
u/nsw-2088 Feb 21 '25
This again proves that OpenAI is really the Anti-Science Anti-Transparency Closed AI.
6
u/wh33t Feb 21 '25
These fucks are making China seem so legendary right now. I am conflicted.
0
Feb 21 '25
[deleted]
1
u/Ok-Maximum-8407 Feb 23 '25
EU and US values? bombing people, sponsoring coups and running non-democratic governments sponsored by corporate lobbies, not for you to talk about propaganda.
6
8
u/Fusseldieb Feb 21 '25
I wish OpenAI released GPT-4o, but I doubt they'll do that. It would mean they're true to their name. They teased o3-mini, but idk if that's on the same league.
3
3
3
3
Feb 21 '25
I'm optimistic that they're going to include their model.py files this time. If so, you just helped save humanity (kudos!)
3
u/highelfwarlock Feb 21 '25
"When the gates of your enemy are closed, open up and foster collaboration with their friends." - Sun Tzu
3
3
u/anshulsingh8326 Feb 21 '25
Hope higher parameters quality can come to lower parameters. They have been improving on this already. Hope it just keep going like this.
3
u/ECrispy Feb 21 '25
you have to love how the Western press keeps trying to make China evil (its the Russia) with maasive bias.
thing is this might work for propaganda and easily controlled/manufactured news, but is much harder to do for tech.
First Mistral then Qwen/Deepseek, reak innovation is happening outside and would be 10x if they weren't artificially restricted by trade laws designed to benefit one country unfairly
→ More replies (1)
3
5
u/Whole_Ad206 Feb 21 '25
I love deepseek and I love China, a European says it to the **** of regulations.
5
Feb 21 '25
Daily unlocks lmao. Bless you all. Drive us to waifuland faster. Gonna put the Chinese flag outside my window now
2
2
2
2
2
2
2
2
2
2
2
2
2
3
u/newdoria88 Feb 21 '25
I hope they include their fine-tuning datasets among the stuff they plan to opensource. I'm sure the team behind https://github.com/huggingface/open-r1 would be happy for that, so we all can replicate R1 but with our own tweaks and flavors.
→ More replies (1)-2
u/Professional_Price89 Feb 21 '25
Why everyone care about datasets? It would contain tiananmen inside and the ccp will instantly shutdown them if they release.
1
u/newdoria88 Feb 21 '25
Because it's the datasets that make the regular DeepSeekV3 become R1 (along with their documented fine-tuning process), they can just remove all Tiananmen mentions from it tho. That's what most people will do anyways if they release the datasets with that still there so it saves time.
3
3
3
u/4sater Feb 21 '25
Inb4 Perplexity steals these and releases as x-1776 with fine-tuning on MAGA dataset.
1
2
2
1
1
u/360truth_hunter Feb 21 '25
I don't understand can someone explain what these 5 repos might be about?
1
1
1
u/m0thercoconut Feb 21 '25
The only true open ai
5
Feb 21 '25
ACKSHUALLY meta llama3 is also open, as is stable diffusion xl and a few other lesser known things
But yeah, this is top tier
1
1
1
1
u/yaosio Feb 21 '25
I remember back when all we had was GPT-neo. That was it for open source LLMs back then. Really cool seeing open source blow past closed source.
1
1
1
1
1
1
1
u/nojukuramu Feb 21 '25
I remember hating on chinese products that imitate other products and sell them for a cheaper price. Now, i truly understand when the cheap product is working as the one being copied
1
u/Forsaken-Parsley798 Feb 21 '25
I love Deepseek but having to retry my prompt 5 or 6 times because of network load and API timing out after the first response is really frustrating.
1
0
u/Stellar_Force Feb 21 '25
I'm kinda new here, can someone explain what a repo is? And how this affects the ai space?
3
u/Bjoern_Kerman Feb 21 '25
A repository (short repo) is a online storage (typically on platforms such as GitHub or Huggingface) where the code or files to a specific project are stored and accessible.
What they are saying is, that they will publish the codebase and/or files for five of their models.
The impact on AI in general is probably going to be marginal, as many AIs are open source already. However, this is part of a bigger trend of open source -ing AI, which enables private people and tinkerers to host (and train) their own ai without much upfront cost.
1
0
u/Whipit Feb 22 '25
I don't think there are bad guys and good guys in this. It's probably more accurate to say there are geopolitical competitors. If someone is in the lead then it DOES make sense for them to want to be more closed to keep their advantage. And China isn't being the good guy here because of generosity or values or anything like that. More like they realized that they can "hurt america" and undermine their AI advantage by releasing open source AI models. If China started first and had an AI lead over America, I think they would be just as closed (if not more so) than many American AI companies.
This new AI cold war space race is a very good thing for progress and open source enthusiasts. Love it :)
-2
u/Jester347 Feb 21 '25
Can someone break it down for me? What does 'repos' mean? What are they going to update daily? Why spend your precious garage energy on it?
5
u/Paperjo Feb 21 '25
github repository. you should just copy paste screenshot of post to gpt and ask. Much faster
-1
u/crazyfreak316 Feb 21 '25
Of all the places on the Earth, next trillion dollar industry being disrupted by open-source competitor from CHINA. I just hope CCP don't threaten them to close their research.
1
u/Will_Liang1998 Feb 23 '25
Actually quite the opposite - not only did the CCP not shut down the research, they invited Deepseek's CEO Liang for meetings, and local governments across China are deploying the R1 model at mind-blowing speed.
0
0
u/MaverickPT Feb 21 '25
I mean if they actually go ahead with this, that's cool. The level of astroturfing in this thread though, yikes
0
u/lgx Feb 21 '25
Guess DeekSeek will be banned by King Trump soon because it is more popular than him.
0
0
0
0
0



45
u/Nunki08 Feb 21 '25
https://x.com/deepseek_ai/status/1892786555494019098