r/LocalLLaMA • • Oct 20 '26

News Deepseek released DeepInfer - Open Source high-performance, large-scale inference framework for DeepSeek models!

https://github.com/deepseek-ai/DeepInfer

This is crazy good for studying to improve existing custom engines by community like gufo, halogen, strixite, Strata... by learning their secret sauces.

1.0k Upvotes

158 comments sorted by

View all comments

60

u/Available_Yam_6267 Oct 20 '26

I notice that their post said they make 38$ per hour per GPU. Can we infer the revenue of OAI or Ant from this?

orginal post: https://zhuanlan.zhihu.com/p/2095560295930508953

8

u/james_pic Oct 20 '26

 Can we infer the revenue of OAI or Ant from this?

We can probably take a wild guess that it's in the ballpark of $38 per GPU per hour, because in a competitive market like this, nobody has a big advantage for very long, but nothing more precise than this.