Copertina

Bayesian Mixture-of-Experts: Towards Making LLMs Know What They Don't Know

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autore principale:	Li, Albus Yizhuo
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning Statistics Theory
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Variational Routing: A Scalable Bayesian Framework for Calibrated Mixture-of-Experts Transformers
di: Li, Albus Yizhuo, et al.
Pubblicazione: (2026)

Experts Don't Cheat: Learning What You Don't Know By Predicting Pairs
di: Johnson, Daniel D., et al.
Pubblicazione: (2024)

Large Language Models Must Be Taught to Know What They Don't Know
di: Kapoor, Sanyam, et al.
Pubblicazione: (2024)

Know What You Don't Know: Uncertainty Calibration of Process Reward Models
di: Park, Young-Jin, et al.
Pubblicazione: (2025)

Know What You Don't Know: Selective Prediction for Early Exit DNNs
di: Bajpai, Divya Jyoti, et al.
Pubblicazione: (2025)

Don't Pass@k: A Bayesian Framework for Large Language Model Evaluation
di: Hariri, Mohsen, et al.
Pubblicazione: (2025)

Knowing What You Know Is Not Enough: Large Language Model Confidences Don't Align With Their Actions
di: Pal, Arka, et al.
Pubblicazione: (2025)

Evaluating LLMs When They Do Not Know the Answer: Statistical Evaluation of Mathematical Reasoning via Comparative Signals
di: Dong, Zihan, et al.
Pubblicazione: (2026)

Improving Minimax Estimation Rates for Contaminated Mixture of Multinomial Logistic Experts via Expert Heterogeneity
di: Yan, Fanqi, et al.
Pubblicazione: (2026)

Can Molecular Foundation Models Know What They Don't Know? A Simple Remedy with Preference Optimization
di: He, Langzhou, et al.
Pubblicazione: (2025)

Can Bayesian Neural Networks Make Confident Predictions?
di: Fisher, Katharine, et al.
Pubblicazione: (2025)

Generalization and Scaling Laws for Mixture-of-Experts Transformers
di: Mayaki, Mansour Zoubeirou a
Pubblicazione: (2026)

Bayesian Semiparametric Mixture Cure (Frailty) Models
di: Kızılaslan, Fatih, et al.
Pubblicazione: (2025)

Model Selection for Gaussian-gated Gaussian Mixture of Experts Using Dendrograms of Mixing Measures
di: Thai, Tuan, et al.
Pubblicazione: (2025)

Revisiting Incremental Stochastic Majorization-Minimization Algorithms with Applications to Mixture of Experts
di: Tran, TrungKhang, et al.
Pubblicazione: (2026)

Dendrograms of Mixing Measures for Softmax-Gated Gaussian Mixture of Experts: Consistency without Model Sweeps
di: Hai, Do Tien, et al.
Pubblicazione: (2025)

Fast Model Selection and Stable Optimization for Softmax-Gated Multinomial-Logistic Mixture of Experts Models
di: Tran, TrungKhang, et al.
Pubblicazione: (2026)

Towards Bayesian Data Selection
di: Rodemann, Julian
Pubblicazione: (2024)

I Don't Know: Explicit Modeling of Uncertainty with an [IDK] Token
di: Cohen, Roi, et al.
Pubblicazione: (2024)

Show Me What You Don't Know: Efficient Sampling from Invariant Sets for Model Validation
di: Rousselot, Armand, et al.
Pubblicazione: (2026)

What Makes Treatment Effects Identifiable? Characterizations and Estimators Beyond Unconfoundedness
di: Cai, Yang, et al.
Pubblicazione: (2025)

LLMs Don't Know Their Own Decision Boundaries: The Unreliability of Self-Generated Counterfactual Explanations
di: Mayne, Harry, et al.
Pubblicazione: (2025)

Local Minima Structures in Gaussian Mixture Models
di: Chen, Yudong, et al.
Pubblicazione: (2020)

First, Learn What You Don't Know: Active Information Gathering for Driving at the Limits of Handling
di: Davydov, Alexander, et al.
Pubblicazione: (2024)

Mixture of multilayer stochastic block models for multiview clustering
di: De Santiago, Kylliann, et al.
Pubblicazione: (2024)

Deep Bayesian Inversion
di: Adler, Jonas, et al.
Pubblicazione: (2018)

Nonparametric MLE for Gaussian Location Mixtures: Certified Computation and Generic Behavior
di: Polyanskiy, Yury, et al.
Pubblicazione: (2025)

Sharp Inequalities between Total Variation and Hellinger Distances for Gaussian Mixtures
di: Jung, Joonhyuk, et al.
Pubblicazione: (2026)

Variational Approach for Efficient KL Divergence Estimation in Dirichlet Mixture Models
di: Pal, Samyajoy, et al.
Pubblicazione: (2024)

Adaptive Mean Estimation in the Hidden Markov sub-Gaussian Mixture Model
di: Karagulyan, Vahe, et al.
Pubblicazione: (2024)

Gaussian Mixture Model with unknown diagonal covariances via continuous sparse regularization
di: Giard, Romane, et al.
Pubblicazione: (2025)

Susceptibilities and Patterning: A Primer on Linear Response in Bayesian Learning
di: Elliott, Chris, et al.
Pubblicazione: (2026)

Sequential Bayesian Neural Subnetwork Ensembles
di: Jantre, Sanket, et al.
Pubblicazione: (2022)

On uncertainty-penalized Bayesian information criterion
di: Thanasutives, Pongpisit, et al.
Pubblicazione: (2024)

Online Statistical Inference in Decision-Making with Matrix Context
di: Han, Qiyu, et al.
Pubblicazione: (2022)

Singular Fluctuation as Specific Heat in Bayesian Learning
di: Plummer, Sean
Pubblicazione: (2025)

Thermodynamic Response Functions in Singular Bayesian Models
di: Plummer, Sean
Pubblicazione: (2026)

Frequentist Guarantees of Distributed (Non)-Bayesian Inference
di: Wu, Bohan, et al.
Pubblicazione: (2023)

Towards a unified framework for guided diffusion models
di: Jiao, Yuchen, et al.
Pubblicazione: (2025)

Misclassification bounds for PAC-Bayesian sparse deep learning
di: Mai, The Tien
Pubblicazione: (2024)