MTPareto: A MultiModal Targeted Pareto Framework for Fake News Detection
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915119249752064 |
|---|---|
| author | Yan, Kaiying Liu, Moyang Liu, Yukun Fu, Ruibo Wen, Zhengqi Tao, Jianhua Liu, Xuefei Li, Guanjun |
| author_facet | Yan, Kaiying Liu, Moyang Liu, Yukun Fu, Ruibo Wen, Zhengqi Tao, Jianhua Liu, Xuefei Li, Guanjun |
| contents | Multimodal fake news detection is essential for maintaining the authenticity of Internet multimedia information. Significant differences in form and content of multimodal information lead to intensified optimization conflicts, hindering effective model training as well as reducing the effectiveness of existing fusion methods for bimodal. To address this problem, we propose the MTPareto framework to optimize multimodal fusion, using a Targeted Pareto(TPareto) optimization algorithm for fusion-level-specific objective learning with a certain focus. Based on the designed hierarchical fusion network, the algorithm defines three fusion levels with corresponding losses and implements all-modal-oriented Pareto gradient integration for each. This approach accomplishes superior multimodal fusion by utilizing the information obtained from intermediate fusion to provide positive effects to the entire process. Experiment results on FakeSV and FVC datasets show that the proposed framework outperforms baselines and the TPareto optimization algorithm achieves 2.40% and 1.89% accuracy improvement respectively. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_06764 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | MTPareto: A MultiModal Targeted Pareto Framework for Fake News Detection Yan, Kaiying Liu, Moyang Liu, Yukun Fu, Ruibo Wen, Zhengqi Tao, Jianhua Liu, Xuefei Li, Guanjun Machine Learning Multimodal fake news detection is essential for maintaining the authenticity of Internet multimedia information. Significant differences in form and content of multimodal information lead to intensified optimization conflicts, hindering effective model training as well as reducing the effectiveness of existing fusion methods for bimodal. To address this problem, we propose the MTPareto framework to optimize multimodal fusion, using a Targeted Pareto(TPareto) optimization algorithm for fusion-level-specific objective learning with a certain focus. Based on the designed hierarchical fusion network, the algorithm defines three fusion levels with corresponding losses and implements all-modal-oriented Pareto gradient integration for each. This approach accomplishes superior multimodal fusion by utilizing the information obtained from intermediate fusion to provide positive effects to the entire process. Experiment results on FakeSV and FVC datasets show that the proposed framework outperforms baselines and the TPareto optimization algorithm achieves 2.40% and 1.89% accuracy improvement respectively. |
| title | MTPareto: A MultiModal Targeted Pareto Framework for Fake News Detection |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2501.06764 |