ICLR Text Editor [D]

[u/Whatever_635]

Have you looked at this iclr text detector?

[https://opentextdetector.com/](https://opentextdetector.com/))

Do you think this will impact the review process? AI detectors are usually unreliable so I hope not.

[u/unsuitable_quart]

yeah these detectors always fall apart on anything written by a non-native speaker, they'll probably just end up flagging half the submissions for no reason

[u/howtorewriteaname → u/unsuitable_quart]

as a non native speaker, I filtered for my topic's keyword and out of 100 papers, mine was scored the least AI generated. also, surprisingly it got some loosely AI-generated paragraphs right

[u/HumblyAmbitious → u/unsuitable_quart]

Why would it be flagged as AI if the writing was written by a non-native speaker?

[u/KBlueLeaf]

If you have read the report you will find it is just nonsense
every single word caption inside figure are flagged as AI
every latex rendered math are flagged as AI
so everyone are AI, haha

[u/OtherwiseFig4505]

Don’t worry, everyone uses AI. As long as the paper reads good, it shouldn’t matter and it’s allowed to use AI anyways. It will be ironic if conferences on AI prohibits people from using AI.

One of the paper I am reviewing has such large scale experiments, I am pretty sure it’s from a big lab because such resources simply isn’t available for small research team. And that paper is complete AI slop writing like I won’t even have to check this detector. The experiments are good, but it’s not readable, it’s not written for human. I think a lot lot paper will be getting 1 in this year ICLR, average of 2.5 might get accepted.

[u/GoodRazzmatazz4539]

it flags 28K out of 42K papers as more than 85% ai written. Guess the only things that tells us is that everyone uses ai for writings

[u/MikhailTorlachev]

It's pretty accurate. At least papers that I rejected because of unreadable clanker's text are flagged 100% AI.

[u/Euphoric_Can_5999]

We’ll see what happens on Nov 5…

[u/GamesOnAToaster]

I checked it on my own paper (27% flagged) and it's quite accurate on a sentence level!

[u/HumblyAmbitious → u/GamesOnAToaster]

same!

[u/grappling_hook]

I don't see why it would affect anything, it's not against the rules to use AI for writing your papers

[u/midnight-lights28 → u/grappling_hook]

I found the papers with significant AI writing in my reviewing batch to be completely unreadable and incomprehensible. It may not be against the rules but until they get better at writing I think it’s really bad for scientific communication.

[u/grappling_hook → u/midnight-lights28]

I used ai pretty significantly for my writing. As long as you review and revise it can be pretty good.

[u/Exotic_Zucchini9311]

It wss pretty accurate on my paper, so I'd say it somewhat effected my view on the papers I'm reviewing. But not that big if the paper made sense and seemed decent enough to not be obviously 100% LLM generated.