Abstract
A meta-review usually written by the editor of a journal or the area/program chair in a conference is a summary of the peer-reviews and a concise interpretation of the editors/chairs decision. Although the task closely simulates a multi-document summarization problem, automatically writing reviews on top of human-generated reviews is something very less explored. In this paper, we investigate how current state-of-the-art summarization techniques fare on this problem. We come up with qualitative and quantitative evaluation of four radically different summarization approaches on the current problem. We explore how the summarization models perform on preserving aspects and sentiments in original peer reviews and meta-reviews. Finally, we conclude with our observations on why the task is challenging, different from simple summarization, and how one should approach to design a meta-review generation model. We have provided link for our git repository https://github.com/PrabhatkrBharti/MetaGen.git so as to enable readers to replicate the findings.
Original language | English |
---|---|
Title of host publication | Text, Speech, and Dialogue - 25th International Conference, TSD 2022, Proceedings |
Editors | Petr Sojka, Aleš Horák, Ivan Kopeček, Karel Pala |
Publisher | Springer Science and Business Media Deutschland GmbH |
Pages | 275-287 |
Number of pages | 13 |
ISBN (Print) | 9783031162695 |
DOIs | |
State | Published - 2022 |
Externally published | Yes |
Event | 25th International Conference on Text, Speech, and Dialogue, TSD 2022 - Brno, Czech Republic Duration: Sep 6 2022 → Sep 9 2022 |
Publication series
Name | Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) |
---|---|
Volume | 13502 LNAI |
ISSN (Print) | 0302-9743 |
ISSN (Electronic) | 1611-3349 |
Conference
Conference | 25th International Conference on Text, Speech, and Dialogue, TSD 2022 |
---|---|
Country/Territory | Czech Republic |
City | Brno |
Period | 09/6/22 → 09/9/22 |
Funding
Prabhat Kumar Bharti acknowledges a fellowship grant from Quality Improvement Programme initiated by the All India Council for Technical Education (AICTE), Government of India. Asif Ekbal, the fourth author, has received the Visvesvaraya Young Faculty Award. The author acknowledges and thanks to Digital India Corporation, Ministry of Electronics and Information Technology, Government of India. Tirthankar Ghosal acknowledges and extends his thanks to Cactus Communications, India for funding him. Acknowledgement. Prabhat Kumar Bharti acknowledges a fellowship grant from Quality Improvement Programme initiated by the All India Council for Technical Education (AICTE), Government of India. Asif Ekbal, the fourth author, has received the Visvesvaraya Young Faculty Award. The author acknowledges and thanks to Digital India Corporation, Ministry of Electronics and Information Technology, Government of India. Tirthankar Ghosal acknowledges and extends his thanks to Cactus Communications, India for funding him.
Keywords
- Meta review generation
- Peer reviews
- Text Summarization