Residential College | false |
Status | 已發表Published |
Improving abstractive document summarization with salient information modeling | |
You, Yongjian1,2; Jia, Weijia2; Liu, Tianyi1,2; Yang, Wenmian1,2 | |
2020 | |
Conference Name | 57th Annual Meeting of the Association for Computational Linguistics, ACL 2019 |
Source Publication | ACL 2019 - 57th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference |
Pages | 2132-2141 |
Conference Date | 28 July 2019through 2 August 2019 |
Conference Place | Florence |
Abstract | Comprehensive document encoding and salient information selection are two major difficulties for generating summaries with adequate salient information. To tackle the above difficulties, we propose a Transformer-based encoder-decoder framework with two novel extensions for abstractive document summarization. Specifically, (1) to encode the documents comprehensively, we design a focus-attention mechanism and incorporate it into the encoder. This mechanism models a Gaussian focal bias on attention scores to enhance the perception of local context, which contributes to producing salient and informative summaries. (2) To distinguish salient information precisely, we design an independent saliency-selection network which manages the information flow from encoder to decoder. This network effectively reduces the influences of secondary information on the generated summaries. Experimental results on the popular CNN/Daily Mail benchmark demonstrate that our model outperforms other state-of-the-art baselines on the ROUGE metrics. |
URL | View the original |
Indexed By | CPCI-S ; CPCI-SSH |
Language | 英語English |
WOS Research Area | Computer Science ; Linguistics |
WOS Subject | Computer Science, Artificial Intelligence ; Computer Science, Interdisciplinary Applications ; Linguistics |
WOS ID | WOS:000493046103059 |
Scopus ID | 2-s2.0-85075433593 |
Fulltext Access | |
Citation statistics | |
Document Type | Conference paper |
Collection | Faculty of Science and Technology |
Affiliation | 1.Department of Computer Science and Engineering, Shanghai Jiao Tong University, China 2.State Key Lab of IoT for Smart City, CIS, University of Macau, Macao |
First Author Affilication | University of Macau |
Recommended Citation GB/T 7714 | You, Yongjian,Jia, Weijia,Liu, Tianyi,et al. Improving abstractive document summarization with salient information modeling[C], 2020, 2132-2141. |
APA | You, Yongjian., Jia, Weijia., Liu, Tianyi., & Yang, Wenmian (2020). Improving abstractive document summarization with salient information modeling. ACL 2019 - 57th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference, 2132-2141. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment