Saved in:
| Main Authors: | Poli, Michael, Thomas, Armin W, Nguyen, Eric, Ponnusamy, Pragaash, Deiseroth, Björn, Kersting, Kristian, Suzuki, Taiji, Hie, Brian, Ermon, Stefano, Ré, Christopher, Zhang, Ce, Massaroli, Stefano |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2403.17844 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Systems and Algorithms for Convolutional Multi-Hybrid Language Models at Scale
by: Ku, Jerome, et al.
Published: (2025)
by: Ku, Jerome, et al.
Published: (2025)
Sliding Window Recurrences for Sequence Models
by: Secrieru, Dragos, et al.
Published: (2025)
by: Secrieru, Dragos, et al.
Published: (2025)
STAR: Synthesis of Tailored Architectures
by: Thomas, Armin W., et al.
Published: (2024)
by: Thomas, Armin W., et al.
Published: (2024)
State-Free Inference of State-Space Models: The Transfer Function Approach
by: Parnichkun, Rom N., et al.
Published: (2024)
by: Parnichkun, Rom N., et al.
Published: (2024)
Bounding Hallucinations: Information-Theoretic Guarantees for RAG Systems via Merlin-Arthur Protocols
by: Deiseroth, Björn, et al.
Published: (2025)
by: Deiseroth, Björn, et al.
Published: (2025)
AtManRL: Towards Faithful Reasoning via Differentiable Attention Saliency
by: Höth, Max Henning, et al.
Published: (2026)
by: Höth, Max Henning, et al.
Published: (2026)
Quantifying Memory Utilization with Effective State-Size
by: Parnichkun, Rom N., et al.
Published: (2025)
by: Parnichkun, Rom N., et al.
Published: (2025)
T-FREE: Subword Tokenizer-Free Generative LLMs via Sparse Representations for Memory-Efficient Embeddings
by: Deiseroth, Björn, et al.
Published: (2024)
by: Deiseroth, Björn, et al.
Published: (2024)
LIME: Making LLM Data More Efficient with Linguistic Metadata Embeddings
by: Sztwiertnia, Sebastian, et al.
Published: (2025)
by: Sztwiertnia, Sebastian, et al.
Published: (2025)
AtMan: Understanding Transformer Predictions Through Memory Efficient Attention Manipulation
by: Deiseroth, Björn, et al.
Published: (2023)
by: Deiseroth, Björn, et al.
Published: (2023)
SCAR: Sparse Conditioned Autoencoders for Concept Detection and Steering in LLMs
by: Härle, Ruben, et al.
Published: (2024)
by: Härle, Ruben, et al.
Published: (2024)
Measuring and Guiding Monosemanticity
by: Härle, Ruben, et al.
Published: (2025)
by: Härle, Ruben, et al.
Published: (2025)
Divergent Token Metrics: Measuring degradation to prune away LLM components -- and optimize quantization
by: Deiseroth, Björn, et al.
Published: (2023)
by: Deiseroth, Björn, et al.
Published: (2023)
Exploring Diffusion Transformer Designs via Grafting
by: Chandrasegaran, Keshigeyan, et al.
Published: (2025)
by: Chandrasegaran, Keshigeyan, et al.
Published: (2025)
Training-Free Activation Sparsity in Large Language Models
by: Liu, James, et al.
Published: (2024)
by: Liu, James, et al.
Published: (2024)
Reviving Any-Subset Autoregressive Models with Principled Parallel Sampling and Speculative Decoding
by: Guo, Gabe, et al.
Published: (2025)
by: Guo, Gabe, et al.
Published: (2025)
SequenceMatch: Imitation Learning for Autoregressive Sequence Modelling with Backtracking
by: Cundy, Chris, et al.
Published: (2023)
by: Cundy, Chris, et al.
Published: (2023)
RFG: Test-Time Scaling for Diffusion Large Language Model Reasoning with Reward-Free Guidance
by: Chen, Tianlang, et al.
Published: (2025)
by: Chen, Tianlang, et al.
Published: (2025)
Educação Permanente para o aperfeiçoamento do Controle de Infecção Hospitalar: revisão integrativa
by: Aline Massaroli
Published: (2014)
by: Aline Massaroli
Published: (2014)
Cosmological horizons
by: Fiorentin, Michele Re, et al.
Published: (2025)
by: Fiorentin, Michele Re, et al.
Published: (2025)
Hierarchical Autoregressive Transformers: Combining Byte- and Word-Level Processing for Robust, Adaptable Language Models
by: Neitemeier, Pit, et al.
Published: (2025)
by: Neitemeier, Pit, et al.
Published: (2025)
Who's at Risk? Effects of Inflation on Unemployment Risk
by: Ahn, Hie Joo, et al.
Published: (2025)
by: Ahn, Hie Joo, et al.
Published: (2025)
Privacy-Constrained Policies via Mutual Information Regularized Policy Gradients
by: Cundy, Chris, et al.
Published: (2020)
by: Cundy, Chris, et al.
Published: (2020)
Inductive Moment Matching
by: Zhou, Linqi, et al.
Published: (2025)
by: Zhou, Linqi, et al.
Published: (2025)
Calibrated Probabilistic Forecasts for Arbitrary Sequences
by: Marx, Charles, et al.
Published: (2024)
by: Marx, Charles, et al.
Published: (2024)
TrAct: Making First-layer Pre-Activations Trainable
by: Petersen, Felix, et al.
Published: (2024)
by: Petersen, Felix, et al.
Published: (2024)
Discrete Diffusion Modeling by Estimating the Ratios of the Data Distribution
by: Lou, Aaron, et al.
Published: (2023)
by: Lou, Aaron, et al.
Published: (2023)
Adaptive Inference-Time Compute: LLMs Can Predict if They Can Do Better, Even Mid-Generation
by: Manvi, Rohin, et al.
Published: (2024)
by: Manvi, Rohin, et al.
Published: (2024)
DistillKac: Few-Step Image Generation via Damped Wave Equations
by: Han, Weiqiao, et al.
Published: (2025)
by: Han, Weiqiao, et al.
Published: (2025)
Mission Design for Unmanned Aerial Vehicles using Hybrid Probabilistic Logic Programs
by: Kohaut, Simon, et al.
Published: (2024)
by: Kohaut, Simon, et al.
Published: (2024)
Um modelo setorial baseado na abordagem kaleckiana da distribuição setorial funcional da renda e na teoria schumpeteriana da concorrência
by: Tatiana Massaroli Melo
Published: (2016)
by: Tatiana Massaroli Melo
Published: (2016)
Competitividade e gap tecnológico – uma análise comparativa entre Brasil e países europeus
by: Tatiana Massaroli Melo
Published: (2017)
by: Tatiana Massaroli Melo
Published: (2017)
Direct Preference Optimization: Your Language Model is Secretly a Reward Model
by: Rafailov, Rafael, et al.
Published: (2023)
by: Rafailov, Rafael, et al.
Published: (2023)
Multipole Semantic Attention: A Fast Approximation of Softmax Attention for Pretraining
by: Mitchell, Rupert, et al.
Published: (2025)
by: Mitchell, Rupert, et al.
Published: (2025)
Generative Modeling with Flux Matching
by: Pao-Huang, Peter, et al.
Published: (2026)
by: Pao-Huang, Peter, et al.
Published: (2026)
Self-Refining Diffusion Samplers: Enabling Parallelization via Parareal Iterations
by: Selvam, Nikil Roashan, et al.
Published: (2024)
by: Selvam, Nikil Roashan, et al.
Published: (2024)
An energy landscape-based theoretical framework for understanding the emergence of functions in a living system under the dynamical component interaction
by: Suzuki, Ryunosuke, et al.
Published: (2025)
by: Suzuki, Ryunosuke, et al.
Published: (2025)
Direct Density Ratio Optimization: A Statistically Consistent Approach to Aligning Large Language Models
by: Higuchi, Rei, et al.
Published: (2025)
by: Higuchi, Rei, et al.
Published: (2025)
Transformers Learn Nonlinear Features In Context: Nonconvex Mean-field Dynamics on the Attention Landscape
by: Kim, Juno, et al.
Published: (2024)
by: Kim, Juno, et al.
Published: (2024)
Deep Two-Way Matrix Reordering for Relational Data Analysis
by: Watanabe, Chihiro, et al.
Published: (2021)
by: Watanabe, Chihiro, et al.
Published: (2021)
Similar Items
-
Systems and Algorithms for Convolutional Multi-Hybrid Language Models at Scale
by: Ku, Jerome, et al.
Published: (2025) -
Sliding Window Recurrences for Sequence Models
by: Secrieru, Dragos, et al.
Published: (2025) -
STAR: Synthesis of Tailored Architectures
by: Thomas, Armin W., et al.
Published: (2024) -
State-Free Inference of State-Space Models: The Transfer Function Approach
by: Parnichkun, Rom N., et al.
Published: (2024) -
Bounding Hallucinations: Information-Theoretic Guarantees for RAG Systems via Merlin-Arthur Protocols
by: Deiseroth, Björn, et al.
Published: (2025)