Zeng, Qi https://orcid.org/0000-0002-3696-1538
Sidhu, Mankeerat https://orcid.org/0009-0002-6021-4134
Blume, Ansel https://orcid.org/0009-0004-2401-7621
Chan, Hou Pong https://orcid.org/0000-0001-9207-4178
Wang, Lu https://orcid.org/0000-0003-4922-290X
Ji, Heng
Chapter History
First Online: 13 February 2025
Ethics Statement
: We acknowledge the following potential ethical concerns that may arise. First, the meta-reviews generated by LLMs may contain hallucinations, which may lead to misunderstandings of the original research paper or reviewers’ opinions. Therefore, users should be cautious when using system-generated meta-reviews for recommendation decisions. Second, the use of black-box LLMs for meta-review generation may raise concerns about the transparency of the decision process. Though our method improves explainability by prompting an LLM to provide supporting evidence for the recommendation decision, the evidence may not perfectly reflect the decision-making process. Third, the dataset used in this study mainly focuses on machine learning papers, which could introduce biases to the recommendation decisions. Hence, it is critical to consider these biases when applying our method to generate meta-reviews for research papers in other domains.
Conference Information
Conference Acronym: IJCAI
Conference Name: International Joint Conference on Artificial Intelligence
Conference City: Jeju Island
Conference Country: Korea (Republic of)
Conference Year: 2024
Conference Start Date: 2 August 2024
Conference End Date: 8 August 2024
Conference Number: 33
Conference ID: ijcai2024
Conference URL: https://ijcai24.org/