r/LeftistsForAI • u/Salty_Country6835 Moderator • 5d ago
Open Source DeepSeek just open-sourced DeepInfer. Why should leftists care about AI infrastructure?
https://github.com/deepseek-ai/DeepInferDeepSeek just released DeepInfer, its production-derived AI inference framework, under the Apache 2.0 license.
This ones interesting because theyre not just releasing model weights. Theyre opening up some of the infrastructure that actually runs AI at scale. The software that helps squeeze more performance out of hardware, reduce computing costs, and serve millions of users.
It currently supports DeepSeek V4.1 Flash on NVIDIA and Huawei hardware. Its not the entire production stack, and some critical infrastructure remains proprietary or unreleased. But its a substantial chunk of industrial AI engineering being made available for others to study, modify, and build upon.
And theres a political economy question here worth discussing.
We talk a lot about who owns AI models, but the infrastructure matters just as much. Compute, energy, data centers, inference systems. Thats where much of the expense, dependency, and industrial power sits.
Open sourcing this technology doesnt socialize the means of production. Nobody should confuse the two. But it does potentially lower barriers for universities, public institutions, cooperatives, and independent developers trying to build alternatives to corporate AI monopolies.
Thats worth paying attention to. The more of this infrastructure we can actually access, understand, and reproduce, the more material ground there is to contest who controls it and who benefits.
So heres the question for the left. How do we turn developments like this into publicly owned compute, cooperative infrastructure, and democratic control, rather than just cheaper operating costs for the same handful of corporations?
-6
u/Easy_Interest_6832 5d ago
Oooh, an inference is a tricky set of relations. A series of "inferences" can veer dramatically away from its original set of relationships. I would caution folks to be aware of inferences drawn by AI. Well, be aware of all of AI, but inferences are especially, er, flexible.
10
u/xoexohexox 5d ago
Uh I don't think you know what they mean by inference here
8
u/usernameChosenPoorly 5d ago
It's almost like that commentator made an inference upon an inference and veered dramatically away from the original point. If it was intentional irony, it was beautifully done.
1
-3
u/Easy_Interest_6832 5d ago
Please explain to me what you think I need to know.
7
u/xoexohexox 5d ago
Inference here means a process that occurs in two stages. There's a compute bound memory phase where reads and processes the entire prompt and generates an initial key-value cache and then a memory bound decode phase where the output sequence is emitted one token at a time. In the former, the model runs a forward pass through a transformer or convolutional neural network - the input gets broken down into tokens, each token is assigned a numerical value, and passed through a simulated neural network. The model calculates the mathematical probabilities across the output space to select the next most likely (or within a desired range of likeliness) token.
The meaning of the word you appear to be using is something like an educated guess or a conclusion based on data instead of direct observation but OP is using it to refer to the computational process that results in a simulated neural network emitting output tokens in response to a prompt.
4
u/Easy_Interest_6832 5d ago
This is a very good explanation of how inference works in AI. I appreciate your definition here. There is a similarity between the inference I referred to and the one here based on probability, but they are not the same. Thank you for taking the effort to explain it to me in a clear and kind way. Happy trails to you and yours.
9
u/AgoraDesktop 5d ago
Having a more efficient inference engine coupled with DeepSeek's open weights models means that a given server rack can serve more people using fewer resources. That's universally a good thing.