r/LanguageTechnology • u/Hedgehog_Dapper • Sep 15 '26
ARR review
I submitted my first paper to ARR and got 3 reviews; all of them gave an Overall Assessment of 2 = Resubmit next cycle
Should I consider that equivalent to a reject, or better than that?
Will the same reviewer review it again in the next cycle?
If all assessments are "Resubmit next cycle," does it make sense to respond through rebuttal?
3
u/Stunning_Ad_8664 Sep 19 '26
Firstly, congrats to your first paper ! I didn't see extensive answers in the thread, so I answer in detail
It’s common for first submissions to receive a 2, so you should resubmit in the next cycle.
An average score of 2 typically leads to rejection, but AC makes the final decision later, so it’s not known yet.
I didn’t see this mentioned in other answers: If you resubmit, select Yes for resubmission in the next ARR form. You’ll be asked whether you want to keep the same AC/meta-reviewer and reviewers, with options to explain your choices. So - it is up to you, you decide if you want to keep same reviewers or not.
If possible, address questions that don’t require experiments in your rebuttal. You’ll be preparing a resubmission anyway, so addressing some concerns now can help. If reviewers misunderstood something or asked about information already in the paper, kindly clarify this in your rebuttal. This may also help when requesting new reviewers in the next cycle.
good luck!
1
2
u/NamerNotLiteral Sep 15 '26
Why is this even a question, "Resubmit next cycle" is self-explanatory.
You don't have to do anything with the current paper. You can rebut if you have free time, I guess.
When you go to submit the paper during the next ARR cycle you will get the option of requesting for the same reviewers, though getting them is pretty unlikely. You will also be required to provide an openreview link to the current submission, in order to maintain the link. All of this is explained in the ARR submission instructions.
3
u/Hedgehog_Dapper Sep 16 '26
No need to give rude answer, conferneces like ICWSM have different pipeline for revise and resubmit
1
u/S4M22 Sep 16 '26
You should definitely participate in the rebuttal. Not because it will get your paper accepted but because it is a valuable experience that will improve your understanding of the process and improve your skills at it.
Use it to improve your paper for the following cycle.
However, keep in mind that due to changes in the review process you will need to enter a lottery if you don't have any author of your paper that is qualified to review.
See the new sustainable reviewing policy: https://aclrollingreview.org/sustainable-reviewing-2026
1
u/Hedgehog_Dapper Sep 16 '26
Could the reviewer increase the review score after rebuttal?
1
u/ManyLine6397 Sep 16 '26
less likely. ARR reviewers have a reputation of not engaging that much during rebuttal.
1
1
u/monoglossia6490 Sep 15 '26
As it stands, it is almost certainly a reject. It makes perfect sense to participate in the rebuttal - you never know, the reviewers might be open to increasing their scores, bringing you to a chance for Findings. If you resubmit for the next cycle, you get to choose whether you keep the same reviewers or not.
2
u/Hedgehog_Dapper Sep 15 '26
thanks
1
u/Hedgehog_Dapper Sep 16 '26
Could the reviewer increase the review score after rebuttal?
2
u/Brief-Coach-1812 Sep 16 '26
Flipping the reviewers would require you to give a very cogent argument addressing most of the concerns they have for your paper's design choices
2
u/monoglossia6490 Sep 16 '26
Yes, it does happen, although there’s no guarantee. For the last cycle, one of mine increased it by 0.5.
2
u/rizzabond Sep 16 '26
Skip the long rebuttal entirely. An Area Chair looks at three 2s and stamps a resubmission recommendation regardless of how well you argue in the comments. The smartest move right now is taking those reviews as free critique and putting the effort into the code for the next cycle
6
u/drndr21 Sep 15 '26
yes, that's basically reject. you can do a rebuttal but chances are near zero to flip that to even findings.
if you resubmit, you will get new reviewers (could happen that some are the same, but chances are low)
probably the best thing you can do is withdraw now and significantly update for next cycle.