Cover Image

Self-Supervised Learning for Neural Topic Models with Variance-Invariance-Covariance Regularization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Xu, Weiran, Hirami, Kengo, Eguchi, Koji
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

RVPO: Risk-Sensitive Alignment via Variance Regularization
by: Montero, Ivan, et al.
Published: (2026)

Variance Covariance Regularization Enforces Pairwise Independence in Self-Supervised Representations
by: Mialon, Grégoire, et al.
Published: (2022)

From Variance to Invariance: Qualitative Content Analysis for Narrative Graph Annotation
by: Huang, Junbo, et al.
Published: (2026)

Topics as Entity Clusters: Entity-based Topics from Large Language Models and Graph Neural Networks
by: Loureiro, Manuel V., et al.
Published: (2023)

Towards Generalising Neural Topical Representations
by: Yang, Xiaohao, et al.
Published: (2023)

Variance-Covariance Regularization Improves Representation Learning
by: Zhu, Jiachen, et al.
Published: (2023)

Can I understand what I create? Self-Knowledge Evaluation of Large Language Models
by: Tan, Zhiquan, et al.
Published: (2024)

Topic Modeling in Marathi
by: Shinde, Sanket, et al.
Published: (2025)

Reinforcement Learning-based Knowledge Distillation with LLM-as-a-Judge
by: Shen, Yiyang, et al.
Published: (2026)

CREAM: Consistency Regularized Self-Rewarding Language Models
by: Wang, Zhaoyang, et al.
Published: (2024)

VCRL: Variance-based Curriculum Reinforcement Learning for Large Language Models
by: Jiang, Guochao, et al.
Published: (2025)

Evaluating Negative Sampling Approaches for Neural Topic Models
by: Adhya, Suman, et al.
Published: (2025)

Improving Neural Topic Models with Wasserstein Knowledge Distillation
by: Adhya, Suman, et al.
Published: (2023)

Probabilistic Topic Modelling with Transformer Representations
by: Reuter, Arik, et al.
Published: (2024)

On Lexical Invariance on Multisets and Graphs
by: Zhang, Muhan
Published: (2024)

A Reproducible Framework for Neural Topic Modeling in Focus Group Analysis
by: Arfaoui, Heger, et al.
Published: (2025)

LimTopic: LLM-based Topic Modeling and Text Summarization for Analyzing Scientific Articles limitations
by: Azhar, Ibrahim Al, et al.
Published: (2025)

Tethering Broken Themes: Aligning Neural Topic Models with Labels and Authors
by: Nagda, Mayank, et al.
Published: (2024)

GINopic: Topic Modeling with Graph Isomorphism Network
by: Adhya, Suman, et al.
Published: (2024)

Topic Modelling: Going Beyond Token Outputs
by: Williams, Lowri, et al.
Published: (2024)

Accelerating Large Language Model Inference with Self-Supervised Early Exits
by: Valade, Florian
Published: (2024)

Leveraging Large Language Models and Topic Modeling for Toxicity Classification
by: Oskouie, Haniyeh Ehsani, et al.
Published: (2024)

SelfCite: Self-Supervised Alignment for Context Attribution in Large Language Models
by: Chuang, Yung-Sung, et al.
Published: (2025)

Exploring Public Attention in the Circular Economy through Topic Modelling with Twin Hyperparameter Optimisation
by: Song, Junhao, et al.
Published: (2024)

Neural Diversity Regularizes Hallucinations in Language Models
by: Chakrabarti, Kushal, et al.
Published: (2025)

Self-Harmony: Learning to Harmonize Self-Supervision and Self-Play in Test-Time Reinforcement Learning
by: Wang, Ru, et al.
Published: (2025)

Self-Supervised Multimodal Learning: A Survey
by: Zong, Yongshuo, et al.
Published: (2023)

EmoPerso: Enhancing Personality Detection with Self-Supervised Emotion-Aware Modelling
by: Shen, Lingzhi, et al.
Published: (2025)

CEMTM: Contextual Embedding-based Multimodal Topic Modeling
by: Abaskohi, Amirhossein, et al.
Published: (2025)

Topic Modeling with Fine-tuning LLMs and Bag of Sentences
by: Schneider, Johannes
Published: (2024)

Semiparametric Latent Topic Modeling on Consumer-Generated Corpora
by: Dayta, Dominic B., et al.
Published: (2021)

MapFormer: Self-Supervised Learning of Cognitive Maps with Input-Dependent Positional Embeddings
by: Rambaud, Victor, et al.
Published: (2025)

Model Directions, Not Words: Mechanistic Topic Models Using Sparse Autoencoders
by: Zheng, Carolina, et al.
Published: (2025)

Learning While Staying Curious: Entropy-Preserving Supervised Fine-Tuning via Adaptive Self-Distillation for Large Reasoning Models
by: Wang, Hao, et al.
Published: (2026)

DVAO: Dynamic Variance-adaptive Advantage Optimization for Multi-reward Reinforcement Learning
by: Jiang, Guochao, et al.
Published: (2026)

Causality $\neq$ Invariance: Function and Concept Vectors in LLMs
by: Opiełka, Gustaw, et al.
Published: (2026)

A Minimum Description Length Approach to Regularization in Neural Networks
by: Abudy, Matan, et al.
Published: (2025)

Advancing Regular Language Reasoning in Linear Recurrent Neural Networks
by: Fan, Ting-Han, et al.
Published: (2023)

COPR: Continual Learning Human Preference through Optimal Policy Regularization
by: Zhang, Han, et al.
Published: (2023)

Dynamic Embedded Topic Models: properties and recommendations based on diverse corpora
by: Fittschen, Elisabeth, et al.
Published: (2025)