Residential College | false |
Status | 已發表Published |
Balancing Privacy and Robustness in Prompt Learning for Large Language Models | |
Shi, Chiyu1; Su, Junyu2; Chu, Chiawei1; Wang, Baoping3; Feng, Duanyang1 | |
2024-11-01 | |
Source Publication | Mathematics |
ISSN | 2227-7390 |
Volume | 12Issue:21Pages:3359 |
Abstract | This paper tackles the critical issue of privacy in Natural Language Processing (NLP) systems that process sensitive data by introducing a novel framework combining differential privacy and adversarial training. The proposed solution ensures formal privacy guarantees by minimizing the influence of individual data points on the model’s behavior, effectively preventing information leakage. Simultaneously, adversarial training is applied to strengthen model robustness against privacy attacks by exposing it to adversarial examples during training. The framework is rigorously evaluated across various NLP tasks, demonstrating its capability to balance privacy preservation with high utility effectively. These results mark a significant advancement in developing secure and reliable NLP systems, particularly for applications requiring stringent data confidentiality, such as healthcare and finance. |
Keyword | Privacy Protextion Large Language Model Prompt Learning |
DOI | 10.3390/math12213359 |
URL | View the original |
Indexed By | SCIE |
Language | 英語English |
WOS Research Area | Mathematics |
WOS Subject | Mathematics |
WOS ID | WOS:001351822600001 |
Publisher | MDPI, ST ALBAN-ANLAGE 66, CH-4052 BASEL, SWITZERLAND |
Scopus ID | 2-s2.0-85208431020 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | Faculty of Science and Technology |
Corresponding Author | Wang, Baoping |
Affiliation | 1.Faculty of Data Science City, University of Macau, Macau 999078, China 2.Faculty of Art and Communication, Kunming University of Science and Technology, Kunming 650032, China 3.School of Management, Guangdong University of Science and Technology, Dongguan 523070, China |
First Author Affilication | University of Macau |
Recommended Citation GB/T 7714 | Shi, Chiyu,Su, Junyu,Chu, Chiawei,et al. Balancing Privacy and Robustness in Prompt Learning for Large Language Models[J]. Mathematics, 2024, 12(21), 3359. |
APA | Shi, Chiyu., Su, Junyu., Chu, Chiawei., Wang, Baoping., & Feng, Duanyang (2024). Balancing Privacy and Robustness in Prompt Learning for Large Language Models. Mathematics, 12(21), 3359. |
MLA | Shi, Chiyu,et al."Balancing Privacy and Robustness in Prompt Learning for Large Language Models".Mathematics 12.21(2024):3359. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment