Image de couverture de livre

Dispersion Loss Counteracts Embedding Condensation and Improves Generalization in Small Language Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Liu, Chen, Sun, Xingzhi, Xiao, Xi, Van Tassel, Alexandre, Xu, Ke, Reimann, Kristof, Liao, Danqi, Gerstein, Mark, Wang, Tianyang, Wang, Xiao, Krishnaswamy, Smita
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

STAGED: A Multi-Agent Neural Network for Learning Cellular Interaction Dynamics
par: Rocha, Joao F., et autres
Publié: (2025)

CTR-LoRA: Curvature-Aware and Trust-Region Guided Low-Rank Adaptation for Large Language Models
par: Wang, Zhuxuanzi, et autres
Publié: (2025)

Self-Supervised Visual Prompting for Cross-Domain Road Damage Detection
par: Xiao, Xi, et autres
Publié: (2025)

DiffKillR: Killing and Recreating Diffeomorphisms for Cell Annotation in Dense Microscopy Images
par: Liu, Chen, et autres
Publié: (2024)

Project risk and the bank monitored credit line
par: Eric Van Tassel
Publié: (2024)

Geometry-Aware Generative Autoencoders for Warped Riemannian Metric Learning and Generative Modeling on Data Manifolds
par: Sun, Xingzhi, et autres
Publié: (2024)

RNAGenScape: Property-Guided, Optimized Generation of mRNA Sequences with Manifold Langevin Dynamics
par: Liao, Danqi, et autres
Publié: (2025)

Linearized Optimal Transport for Analysis of High-Dimensional Point-Cloud and Single-Cell Data
par: Wang, Tianxiang, et autres
Publié: (2025)

MIOFlow 2.0: A unified framework for inferring cellular stochastic dynamics from single cell and spatial transcriptomics data
par: Sun, Xingzhi, et autres
Publié: (2026)

Risk‐Free Rates and Convenience Yields around the World
par: William Diamond, et autres
Publié: (2026)

OP in Europe: test
par: Tassel, Cécile
Publié: (2024)

O corpo e a máquina: um terreno de experiência, a clínica do adolescente
par: Anne Tassel
Publié: (2009)

Improving Language Understanding from Screenshots
par: Gao, Tianyu, et autres
Publié: (2024)

Learning Straight Flows: Variational Flow Matching for Efficient Generation
par: Ma, Chenrui, et autres
Publié: (2025)

CAD-VAE: Leveraging Correlation-Aware Latents for Comprehensive Fair Disentanglement
par: Ma, Chenrui, et autres
Publié: (2025)

Stochastic Interpolants via Conditional Dependent Coupling
par: Ma, Chenrui, et autres
Publié: (2025)

InfoGain Wavelets: Furthering the Design of Graph Diffusion Wavelets
par: Johnson, David R., et autres
Publié: (2025)

Efficient Privacy-Preserving Training of Quantum Neural Networks by Using Mixed States to Represent Input Data Ensembles
par: Wang, Gaoyuan, et autres
Publié: (2025)

Language Models that Think, Chat Better
par: Bhaskar, Adithya, et autres
Publié: (2025)

Principal Curvatures Estimation with Applications to Single Cell Data
par: Zhang, Yanlei, et autres
Publié: (2025)

Beyond Editing Pairs: Fine-Grained Instructional Image Editing via Multi-Scale Learnable Regions
par: Ma, Chenrui, et autres
Publié: (2025)

Boosting Active Learning with Knowledge Transfer
par: Wang, Tianyang, et autres
Publié: (2025)

Statistical Independence and the Brockwell Transform -- From an Integral Equation Perspective
par: Wang, Xingzhi
Publié: (2024)

Improved prediction of ligand-protein binding affinities by meta-modeling
par: Lee, Ho-Joon, et autres
Publié: (2023)

Hierarchies over Vector Space: Orienting Word and Graph Embeddings
par: Guo, Xingzhi, et autres
Publié: (2022)

4D Multimodal Co-attention Fusion Network with Latent Contrastive Alignment for Alzheimer's Diagnosis
par: Wei, Yuxiang, et autres
Publié: (2025)

MoRE-Brain: Routed Mixture of Experts for Interpretable and Generalizable Cross-Subject fMRI Visual Decoding
par: Wei, Yuxiang, et autres
Publié: (2025)

Environment-Aware Indoor LoRaWAN Ranging Using Path Loss Model Inversion and Adaptive RSSI Filtering
par: Obiri, Nahshon Mokua, et autres
Publié: (2025)

A Comprehensive Data Description for LoRaWAN Path Loss Measurements in an Indoor Office Setting: Effects of Environmental Factors
par: Obiri, Nahshon Mokua, et autres
Publié: (2025)

Environment-Aware Indoor LoRaWAN Path Loss: Parametric Regression Comparisons, Shadow Fading, and Calibrated Fade Margins
par: Obiri, Nahshon Mokua, et autres
Publié: (2025)

Hyperedge Representations with Hypergraph Wavelets: Applications to Spatial Transcriptomics
par: Sun, Xingzhi, et autres
Publié: (2024)

fMRI-LM: Towards a Universal Foundation Model for Language-Aligned fMRI Understanding
par: Wei, Yuxiang, et autres
Publié: (2025)

$ζ$-QVAE: A Quantum Variational Autoencoder utilizing Regularized Mixed-state Latent Representations
par: Wang, Gaoyuan, et autres
Publié: (2024)

ACPO: Counteracting Likelihood Displacement in Vision-Language Alignment with Asymmetric Constraints
par: Huang, Kaili, et autres
Publié: (2026)

An adaptive ANOVA stochastic Galerkin method for partial differential equations with high-dimensional random inputs
par: Wang, Guanjie, et autres
Publié: (2023)

Simple Graph Condensation
par: Xiao, Zhenbang, et autres
Publié: (2024)

ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings
par: Hao, Shibo, et autres
Publié: (2023)

DYMAG: Rethinking Message Passing Using Dynamical-systems-based Waveforms
par: Bhaskar, Dhananjay, et autres
Publié: (2023)

FOCUS: Fused Observation of Channels for Unveiling Spectra
par: Xiao, Xi, et autres
Publié: (2025)

Congestion Control for Spraying with Congested Paths
par: Gerstein, Barak, et autres
Publié: (2025)