Sound Research WIKINDX

WIKINDX Resources  

Mishra, S. K., Goel, P., Sharma, A., Jagannatha, A., Jacobs, D., & Daumé, H. 2020. Towards automatic generation of questions from long answers. arXiv. 
Added by: Mark Grimshaw-Aagaard (31/07/2022, 18:41)   Last edited by: Mark Grimshaw-Aagaard (31/07/2022, 18:50)
Resource type: Miscellaneous
DOI: 10.48550/ARXIV.2004.05109
BibTeX citation key: Mishra2020
Email resource to friend
View all bibliographic details
Categories: AI/Machine Learning
Keywords: Creativity, Question generation
Creators: Daumé, Goel, Jacobs, Jagannatha, Mishra, Sharma
Publisher: arXiv
Views: 13/194
Abstract
"Automatic question generation (AQG) has broad applicability in domains such as tutoring systems, conversational agents, healthcare literacy, and information retrieval. Existing efforts at AQG have been limited to short answer lengths of up to two or three sentences. However, several real-world applications require question generation from answers that span several sentences. Therefore, we propose a novel evaluation benchmark to assess the performance of existing AQG systems for long-text answers. We leverage the large-scale open-source Google Natural Questions dataset to create the aforementioned long-answer AQG benchmark. We empirically demonstrate that the performance of existing AQG methods significantly degrades as the length of the answer increases. Transformer-based methods outperform other existing AQG methods on long answers in terms of automatic as well as human evaluation. However, we still observe degradation in the performance of our best performing models with increasing sentence length, suggesting that long answer QA is a challenging benchmark task for future research."
  
WIKINDX 6.8.2 | Total resources: 1301 | Username: -- | Bibliography: WIKINDX Master Bibliography | Style: American Psychological Association (APA)