Copertina

A Minimum Description Length Approach to Regularization in Neural Networks

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Abudy, Matan, Well, Orr, Chemla, Emmanuel, Katzir, Roni, Lan, Nur
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Bridging the Empirical-Theoretical Gap in Neural Network Formal Language Learning Using Minimum Description Length
di: Lan, Nur, et al.
Pubblicazione: (2024)

Large Language Models as Proxies for Theories of Human Linguistic Cognition
di: Ziv, Imry, et al.
Pubblicazione: (2025)

Biasless Language Models Learn Unnaturally: How LLMs Fail to Distinguish the Possible from the Impossible
di: Ziv, Imry, et al.
Pubblicazione: (2025)

Improving Variable-Length Generation in Diffusion Language Models via Length Regularization
di: Cheng, Zicong, et al.
Pubblicazione: (2026)

Advancing Regular Language Reasoning in Linear Recurrent Neural Networks
di: Fan, Ting-Han, et al.
Pubblicazione: (2023)

What Makes Two Language Models Think Alike?
di: Salle, Jeanne, et al.
Pubblicazione: (2024)

Confidence Regularized Masked Language Modeling using Text Length
di: Ji, Seunghyun, et al.
Pubblicazione: (2025)

On the Expressiveness and Length Generalization of Selective State-Space Models on Regular Languages
di: Terzić, Aleksandar, et al.
Pubblicazione: (2024)

Gecko: An Efficient Neural Architecture Inherently Processing Sequences with Arbitrary Lengths
di: Ma, Xuezhe, et al.
Pubblicazione: (2026)

Enhancing Length Extrapolation in Sequential Models with Pointer-Augmented Neural Memory
di: Le, Hung, et al.
Pubblicazione: (2024)

Graph Neural Network Approach to Semantic Type Detection in Tables
di: Hoseinzade, Ehsan, et al.
Pubblicazione: (2024)

Breaking the Language Barrier: Can Direct Inference Outperform Pre-Translation in Multilingual LLM Applications?
di: Intrator, Yotam, et al.
Pubblicazione: (2024)

Bridging Kolmogorov Complexity and Deep Learning: Asymptotically Optimal Description Length Objectives for Transformers
di: Shaw, Peter, et al.
Pubblicazione: (2025)

A Practical Method for Generating String Counterfactuals
di: Avitan, Matan, et al.
Pubblicazione: (2024)

Self-Supervised Learning for Neural Topic Models with Variance-Invariance-Covariance Regularization
di: Xu, Weiran, et al.
Pubblicazione: (2025)

On Non-interactive Evaluation of Animal Communication Translators
di: Paradise, Orr, et al.
Pubblicazione: (2025)

A Combinatorial Approach to Neural Emergent Communication
di: Zhang, Zheyuan
Pubblicazione: (2024)

Towards Generalising Neural Topical Representations
di: Yang, Xiaohao, et al.
Pubblicazione: (2023)

Improving Spoken Language Modeling with Phoneme Classification: A Simple Fine-tuning Approach
di: Poli, Maxime, et al.
Pubblicazione: (2024)

On Provable Length and Compositional Generalization
di: Ahuja, Kartik, et al.
Pubblicazione: (2024)

Neural Diversity Regularizes Hallucinations in Language Models
di: Chakrabarti, Kushal, et al.
Pubblicazione: (2025)

CoNCRA: A Convolutional Neural Network Code Retrieval Approach
di: Martins, Marcelo de Rezende, et al.
Pubblicazione: (2020)

Length Desensitization in Direct Preference Optimization
di: Liu, Wei, et al.
Pubblicazione: (2024)

Prompt Repetition Improves Non-Reasoning LLMs
di: Leviathan, Yaniv, et al.
Pubblicazione: (2025)

Selective Attention Improves Transformer
di: Leviathan, Yaniv, et al.
Pubblicazione: (2024)

Intent-based Prompt Calibration: Enhancing prompt optimization with synthetic boundary cases
di: Levi, Elad, et al.
Pubblicazione: (2024)

Iterative Length-Regularized Direct Preference Optimization: A Case Study on Improving 7B Language Models to GPT-4 Level
di: Liu, Jie, et al.
Pubblicazione: (2024)

A Long Way to Go: Investigating Length Correlations in RLHF
di: Singhal, Prasann, et al.
Pubblicazione: (2023)

A Survey : Neural Networks for AMR-to-Text
di: Hao, Hongyu, et al.
Pubblicazione: (2022)

A Semantic Space is Worth 256 Language Descriptions: Make Stronger Segmentation Models with Descriptive Properties
di: Xiao, Junfei, et al.
Pubblicazione: (2023)

Intrinsic Entropy of Context Length Scaling in LLMs
di: Shi, Jingzhe, et al.
Pubblicazione: (2025)

Diffusion Language Models Are Natively Length-Aware
di: Rossi, Vittorio, et al.
Pubblicazione: (2026)

Controlling Summarization Length Through EOS Token Weighting
di: Belligoli, Zeno, et al.
Pubblicazione: (2025)

TRA: Better Length Generalisation with Threshold Relative Attention
di: Opper, Mattia, et al.
Pubblicazione: (2025)

Explaining Length Bias in LLM-Based Preference Evaluations
di: Hu, Zhengyu, et al.
Pubblicazione: (2024)

Disentangling Length from Quality in Direct Preference Optimization
di: Park, Ryan, et al.
Pubblicazione: (2024)

Metric Learning Encoding Models: A Multivariate Framework for Interpreting Neural Representations
di: Jalouzot, Louis, et al.
Pubblicazione: (2024)

A Survey of Early Exit Deep Neural Networks in NLP
di: Bajpai, Divya Jyoti, et al.
Pubblicazione: (2025)

A Conceptual Framework For Trie-Augmented Neural Networks (TANNS)
di: Adefemi, Temitayo
Pubblicazione: (2024)

SELF: Self-Extend the Context Length With Logistic Growth Function
di: Dang, Phat Thanh, et al.
Pubblicazione: (2025)