Securing Reliability: A Brief Overview on Enhancing In-Context Learning for Foundation Models
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866910345692446720 |
|---|---|
| author | Huang, Yunpeng Gu, Yaonan Xu, Jingwei Zhu, Zhihong Chen, Zhaorun Ma, Xiaoxing |
| author_facet | Huang, Yunpeng Gu, Yaonan Xu, Jingwei Zhu, Zhihong Chen, Zhaorun Ma, Xiaoxing |
| contents | As foundation models (FMs) continue to shape the landscape of AI, the in-context learning (ICL) paradigm thrives but also encounters issues such as toxicity, hallucination, disparity, adversarial vulnerability, and inconsistency. Ensuring the reliability and responsibility of FMs is crucial for the sustainable development of the AI ecosystem. In this concise overview, we investigate recent advancements in enhancing the reliability and trustworthiness of FMs within ICL frameworks, focusing on four key methodologies, each with its corresponding subgoals. We sincerely hope this paper can provide valuable insights for researchers and practitioners endeavoring to build safe and dependable FMs and foster a stable and consistent ICL environment, thereby unlocking their vast potential. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_17671 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Securing Reliability: A Brief Overview on Enhancing In-Context Learning for Foundation Models Huang, Yunpeng Gu, Yaonan Xu, Jingwei Zhu, Zhihong Chen, Zhaorun Ma, Xiaoxing Machine Learning I.2.6 As foundation models (FMs) continue to shape the landscape of AI, the in-context learning (ICL) paradigm thrives but also encounters issues such as toxicity, hallucination, disparity, adversarial vulnerability, and inconsistency. Ensuring the reliability and responsibility of FMs is crucial for the sustainable development of the AI ecosystem. In this concise overview, we investigate recent advancements in enhancing the reliability and trustworthiness of FMs within ICL frameworks, focusing on four key methodologies, each with its corresponding subgoals. We sincerely hope this paper can provide valuable insights for researchers and practitioners endeavoring to build safe and dependable FMs and foster a stable and consistent ICL environment, thereby unlocking their vast potential. |
| title | Securing Reliability: A Brief Overview on Enhancing In-Context Learning for Foundation Models |
| topic | Machine Learning I.2.6 |
| url | https://arxiv.org/abs/2402.17671 |