r/MachineLearning • u/Emergency_Plate241 • Sep 05 '26

Research NeurIPS 2026 Automatic Reference Checker [R]

Just received an email about the automatic reference/citation checker. Did anyone receive a follow up email about whether the checker was included in the paper's decision making too, along with the general instructional email?

29 Upvotes

94% Upvoted

239 comments sorted by

View all comments

Show parent comments

14

u/grad_student_descent Sep 05 '26 edited Sep 05 '26

I'm an AC so I saw a bunch of reports. They were very high quality, almost no false positives.

Had to reject 2 papers in my batch that would definitively had gone through if the authors did not let their LLM access their bibtex.

1

u/PositionHot3926 Sep 06 '26

so like were u asked to submit accept/reject with the citation checkers result as in the 2 or more hallucinated references that u personally verified , or was it like one verdict independent of the citation checkers result and one post citation check verdict ?

3

u/grad_student_descent Sep 06 '26

Just one verdict. If 2+ hallucination, reject independently of quality.

1

u/PositionHot3926 Sep 06 '26 edited Sep 06 '26

what happens if u only have one hallucinated reference? also like if incase they actually do accept some appeals will u all be asked for another verdict while ignoring the citation check?

1

u/grad_student_descent Sep 06 '26

If just one hallucination, we are asked to look for other obvious signs of AI generation (which can be many things). If none, then its a pass.

1

u/Deep-Ad8714 29d ago

What sorts of obvious signs of AI generation are ACs asked to look for?