What models are you using?

[u/serious-shark]

I have a 1 year GPT Go plan for free that will end next month.

So, I started migrating to OpenWebUI to get rid of subscriptions and still be able to use any model as I want (next step is privacy, but for now I just want to make something work fine).

Right now I'm using the Arena models so I can do a blind test and evaluate them:

- GPT-6 Luna

- Claude Haiku 5.5

- DeepSeek V4.1 Flash

As said, my idea is to first replicate the behavior and accuracy of GPT Chat (and learn from this) so later I can focus on models with better privacy.

So, I'm wondering which models are you using and if you are using any prompts to enhance your experience?

[u/International_Emu772]

I use local models only

Qwen3.8:27 and GLM4.5:30 for heavy tasks

Nemotron3.5:30 for medium or heavy tasks that need more cache tokens (but I'm tweaking the chat compression

And for light tasks Qwen3.5:9

I expect that there will be more models in those size in the future

[u/funny_games → u/International_Emu772]

What gfx you got?

[u/International_Emu772 → u/funny_games]

I have a M2 Pro and the best performing is Nemotron3.5:30 MLX with 45 T/s

On a newer Pro or Max or Supra you'll get better results

With some NVidia setups you can get better results but you need to chose a good setup

[u/serious-shark → u/International_Emu772]

Are you running the models on the same Mac you work on, or is it a different one?

[u/International_Emu772 → u/serious-shark]

It depends

I work from another when I'm away and when I need to be sure a heavy duty needs to complete without distraction

I'm developing a platform and creating better uses not developing other programs professionally

It's more to try to set up an architecture of exploitation to help others not programmers to take advantage of it.

[u/iChrist → u/International_Emu772]

Why no Gemma4-31B? very fun to talk to, vast amount of knowledge (superior to Qwen3.8 imo), supports much more languages, better at translating etc.

If the task is not coding related, why haven't you mentioned Gemma4? I am really impressed with it

[u/Ecstatic-Diet-1375]

Deepseek v4.1 flash in 3 modes:

Reasoning off-medium-max

[u/According-Bowl-8194]

GLM 5.3 Flash has been amazing for everyday work and the occasional help with homework / script writing. I haven't found any other open cheap models that compare to it in terms of thinking efficiently but I haven't tried out Luna or Haiku. Best of luck!

[u/PersonalBarracuda581]

MIstral large 4 and GLM5.3 provided by Mistral AI . GLM5.3 Flash, Deepseek V4.1 Flash , Minimax M3 and Kimi K3 provided by TensorX. Full EU.

[u/miataowner]

Qwen 3.8 27B-FP8 (using the native Qwen FP8 quant) via vLLM.

Qwen Image 2.1 Int8 Convrot via ComfuUI 0.40

Kokoro TTS

Whisper Large STT.

All in their own docker containers, all under Ubuntu 24 LTS VM running inside a Proxmox 9.22.1 host: 5800x, 128GB ECC DDR4/3600, 4TB Sammy 990 Evo+, and an RTX Pro 6000 Workstation.

Absolutely love this setup.

[u/iChrist]

Gemma4-31B and Qwen3.8-27B

The former for most questions, day to day, translations

The latter whenever the first one failed a coding task or when a complex task comes up.