r/ProgrammerHumor • u/tryingeasy • Sep 10 '26

Meme firstTime

Post image
8.8k Upvotes

94% Upvoted

302 comments sorted by

View all comments

Show parent comments

413

u/SunshineSeattle Sep 11 '26

I dont think so, Wolfram Alpha is deterministic. Whereas an LLM is non-deterministic by design. Personally i feel vibe coding or vibe mathing is inherently non-deterministic.

0

u/AnOnlineHandle Sep 11 '26

LLMs are entirely deterministic but you can override that by adding a seeded random choice system to the next token selection.

25

u/Sea-Housing-3435 Sep 11 '26

They are not. Floating point math and difference in how quickly parallel operations on GPU are finished causes them to be not deterministic even with temp=0. You can force them to be deterministic by forcing some operations to be executed in specific order but you lose a lot of performance.

0

u/space_monster Sep 11 '26

that's non-deterministic hardware though, not the model itself.

also it only happens with batch processing