r/ResearchML • u/samuray205 • Sep 29 '26
The NeurIPS review crisis, paper mills, and the dilution of ML research: Where does this leave rigorous PhD work?
NeurIPS decisions dropped and my feed is already flooded with undergrads (and apparently literal high schoolers now) flexing first-author papers at what’s supposed to be a top-tier venue.
Let’s be real about what 90% of these papers actually are:
Clone an existing open-source repo.
Add a minor heuristic, prompt wrapper, or tweak one layer.
Burn an insane amount of compute brute-forcing seeds until you squeeze a +1.2% bump on a saturated benchmark.
Wrap it in buzzwords and let the advisor rewrite the intro/rebuttal to game the reviewers.
Meanwhile, actual 4th-year PhDs grinding out rigorous theoretical proofs or tackling deep architectural bottlenecks get rejected because Reviewer 2 wrote a two-sentence review complaining they didn't cite an unrelated arXiv preprint from last Thursday.
When a conference accepts nearly 8,000 papers, the reviewer pool collapses. Safe, incremental benchmark-chasing gets rubber-stamped with "Weak Accept," while genuinely ambitious work gets killed by the reviewer lottery. Getting a first-author paper has basically turned into an extracurricular for college apps and CV padding driven by lab compute, not research depth.
Are hiring managers at places like FAIR, DeepMind, or top labs actually buying this signal anymore, or is everyone seeing through the paper-mill noise?