One Sentence, Two Embeddings: Contrastive Learning of Explicit and Implicit Semantic Representations
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866909991328284672 |
|---|---|
| author | Oda, Kohei Chuang, Po-Min Shirai, Kiyoaki Kertkeidkachorn, Natthawut |
| author_facet | Oda, Kohei Chuang, Po-Min Shirai, Kiyoaki Kertkeidkachorn, Natthawut |
| contents | Sentence embedding methods have made remarkable progress, yet they still struggle to capture the implicit semantics within sentences. This can be attributed to the inherent limitations of conventional sentence embedding methods that assign only a single vector per sentence. To overcome this limitation, we propose DualCSE, a sentence embedding method that assigns two embeddings to each sentence: one representing the explicit semantics and the other representing the implicit semantics. These embeddings coexist in the shared space, enabling the selection of the desired semantics for specific purposes such as information retrieval and text classification. Experimental results demonstrate that DualCSE can effectively encode both explicit and implicit meanings and improve the performance of the downstream task. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_09293 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | One Sentence, Two Embeddings: Contrastive Learning of Explicit and Implicit Semantic Representations Oda, Kohei Chuang, Po-Min Shirai, Kiyoaki Kertkeidkachorn, Natthawut Computation and Language Sentence embedding methods have made remarkable progress, yet they still struggle to capture the implicit semantics within sentences. This can be attributed to the inherent limitations of conventional sentence embedding methods that assign only a single vector per sentence. To overcome this limitation, we propose DualCSE, a sentence embedding method that assigns two embeddings to each sentence: one representing the explicit semantics and the other representing the implicit semantics. These embeddings coexist in the shared space, enabling the selection of the desired semantics for specific purposes such as information retrieval and text classification. Experimental results demonstrate that DualCSE can effectively encode both explicit and implicit meanings and improve the performance of the downstream task. |
| title | One Sentence, Two Embeddings: Contrastive Learning of Explicit and Implicit Semantic Representations |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2510.09293 |