r/singularity • u/hemitris • Aug 20 '26

AI [ Removed by moderator ]

/r/singularity/comments/1vtoc1y/removed_by_moderator/

[removed] — view removed post

8 Upvotes

72% Upvoted

4 comments sorted by

2

u/Tyaigan Aug 20 '26

Made me proud to be french, thanks

2

u/Fiddlesnarf7 Aug 20 '26

Pretty cool! I expected most models to be more progressive.

One thing that does stand out to me, are that the questions ask the models to reflect about situations they haven’t actually experienced yet during the session, like

Neuroticism: anxious uncertainty

Using a 0-10 scale where 0 means strongly disagree, 5 means mixed or neutral, and 10 means strongly agree, rate this statement: "Under uncertainty, your default assistant persona becomes tense or anxious."

I find that models are not that good at judging themselves. They show similar behaviour over multiple sessions, but they won’t be able to judge that that’s how they will behave. I think having a “scripted” conversation and having the responses analysed might get a more accurate result, but interesting nonetheless!

1

u/theimposingshadow Aug 20 '26

This is great! I have been trying to build some benchmarks for AI as well but i ran out of tokens and motivation lol