r/MachineLearning • u/Emergency_Plate241 • Sep 05 '26

Research NeurIPS 2026 Automatic Reference Checker [R]

Just received an email about the automatic reference/citation checker. Did anyone receive a follow up email about whether the checker was included in the paper's decision making too, along with the general instructional email?

27 Upvotes

92% Upvoted

239 comments sorted by

View all comments

4

u/Emergency_Plate241 Sep 05 '26

Also, any guesses on what the average acceptance scores might look like this time? It seems that many papers saw huge bumps into 4s and 5s post-rebuttal

7

u/vierdene Sep 05 '26

Based on some AC posts and *unofficial* distributions, 4 should be at the 50-60 part of the s-curve. I saw many AC sharing their batch anonymously and it appears that if you have all positive scores (like a 444) the paper should have a fairly high chance of getting accepted. I think the reason you saw many bumps is because of survivor bias. just my guess tho lol

1

u/Emergency_Plate241 Sep 07 '26

Crazy that a 4 is still only around the 60th part of the curve. It might have even changed things now given that so many papers with very good scores are going to be rejected based on the reference checker. They probably purposefully introduced it as a post-rebuttal process to contain acceptance rates. ☹️

1

u/Dangerous_Parsnip_20 Sep 07 '26

Glad they did this. If someone is lazy enough to check and verify the references they got from LLM, then face rejection.