UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
Improving abstractive document summarization with salient information modeling
You, Yongjian1,2; Jia, Weijia2; Liu, Tianyi1,2; Yang, Wenmian1,2
2020
Conference Name57th Annual Meeting of the Association for Computational Linguistics, ACL 2019
Source PublicationACL 2019 - 57th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference
Pages2132-2141
Conference Date28 July 2019through 2 August 2019
Conference PlaceFlorence
Abstract

Comprehensive document encoding and salient information selection are two major difficulties for generating summaries with adequate salient information. To tackle the above difficulties, we propose a Transformer-based encoder-decoder framework with two novel extensions for abstractive document summarization. Specifically, (1) to encode the documents comprehensively, we design a focus-attention mechanism and incorporate it into the encoder. This mechanism models a Gaussian focal bias on attention scores to enhance the perception of local context, which contributes to producing salient and informative summaries. (2) To distinguish salient information precisely, we design an independent saliency-selection network which manages the information flow from encoder to decoder. This network effectively reduces the influences of secondary information on the generated summaries. Experimental results on the popular CNN/Daily Mail benchmark demonstrate that our model outperforms other state-of-the-art baselines on the ROUGE metrics.

URLView the original
Indexed ByCPCI-S ; CPCI-SSH
Language英語English
WOS Research AreaComputer Science ; Linguistics
WOS SubjectComputer Science, Artificial Intelligence ; Computer Science, Interdisciplinary Applications ; Linguistics
WOS IDWOS:000493046103059
Scopus ID2-s2.0-85075433593
Fulltext Access
Citation statistics
Document TypeConference paper
CollectionFaculty of Science and Technology
Affiliation1.Department of Computer Science and Engineering, Shanghai Jiao Tong University, China
2.State Key Lab of IoT for Smart City, CIS, University of Macau, Macao
First Author AffilicationUniversity of Macau
Recommended Citation
GB/T 7714
You, Yongjian,Jia, Weijia,Liu, Tianyi,et al. Improving abstractive document summarization with salient information modeling[C], 2020, 2132-2141.
APA You, Yongjian., Jia, Weijia., Liu, Tianyi., & Yang, Wenmian (2020). Improving abstractive document summarization with salient information modeling. ACL 2019 - 57th Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference, 2132-2141.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[You, Yongjian]'s Articles
[Jia, Weijia]'s Articles
[Liu, Tianyi]'s Articles
Baidu academic
Similar articles in Baidu academic
[You, Yongjian]'s Articles
[Jia, Weijia]'s Articles
[Liu, Tianyi]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[You, Yongjian]'s Articles
[Jia, Weijia]'s Articles
[Liu, Tianyi]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.