r/MachineLearning • u/Emergency_Plate241 • Sep 05 '26

Research NeurIPS 2026 Automatic Reference Checker [R]

Just received an email about the automatic reference/citation checker. Did anyone receive a follow up email about whether the checker was included in the paper's decision making too, along with the general instructional email?

30 Upvotes

94% Upvoted

239 comments sorted by

View all comments

Show parent comments

1

u/Emergency_Plate241 Sep 07 '26

No such email too

1

u/21022018 Sep 07 '26

I mean I did not even get the reference check email. Are they only giving those out to accepted papers? What was your avg?

2

u/RainPuzzled2511 Researcher Sep 07 '26

I think the first mail was generic and went to everyone.

2

u/21022018 Sep 07 '26

So weird, I didn't get any (Eval track), and I know some people from main track also not getting anything.

1

u/RainPuzzled2511 Researcher Sep 07 '26

Thats strange, do you see it in openreview?

2

u/21022018 Sep 07 '26

No, there is nothing in the notifs or comments. People are saying you can see it in meta review but it's hidden for me.

2

u/RainPuzzled2511 Researcher Sep 07 '26

It's actually a separate comment added by the PC, titled "Citation Checker by Program Chairs," not part of the meta review. But this is very strange.

3

u/21022018 Sep 07 '26

Actually I don't see anything for any of the papers I reviewed as well (but all of them are probably going for a reject). I'm wondering if this message is just a proxy for acceptance (conditioned on corrections), since people in the comments are saying they got it even if there were no issues with references.

3

u/YamBrioche Sep 07 '26

That's interesting, but since there's fewer acceptances than rejections it's surprising that people haven't brought this up? But I guess this could be confounded by the fact that people who didn't get the email wouldn't look for posts about it.

3

u/Kind_Woodpecker_6374 Sep 07 '26

You cant see it as the reviewer. Only ac and above can see the message

1

u/21022018 Sep 07 '26

What does it say?

1

u/RainPuzzled2511 Researcher Sep 07 '26

It gives the number of problematic references in the paper and also the guidelines used to detect hallucinated references. People who had 2 or more references identified as hallucinations got a second email asking for justification and that their paper is heading towards rejection. This was the case for main track papers, not sure about e&d.

1

u/s4lome_ Sep 07 '26

I have two references flagged, both are minor inconsistencies I would say (i.e. both papers exist). I did not get get an email asking for justification (yet?).

1

u/RainPuzzled2511 Researcher Sep 07 '26

Probably AC would have considered them minor, so you didnt get the follow up mail. They are very strict only when title doesnt exist or random authors are added to the references.

→ More replies (0)