Imagen de Portada

Stochastic activations

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Lomeli, Maria, Douze, Matthijs, Szilvasy, Gergely, Cabannes, Loic, Copet, Jade, Sukhbaatar, Sainbayar, Weston, Jason, Synnaeve, Gabriel, Mazaré, Pierre-Emmanuel, Jégou, Hervé
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Short window attention enables long-term memorization
por: Cabannes, Loïc, et al.
Publicado: (2025)

Self-Pruned Key-Value Attention: Learning When to Write by Predicting Future Utility
por: Szilvasy, Gergely, et al.
Publicado: (2026)

Vector search with small radiuses
por: Szilvasy, Gergely, et al.
Publicado: (2024)

Inference-time sparse attention with asymmetric indexing
por: Mazaré, Pierre-Emmanuel, et al.
Publicado: (2025)

The Faiss library
por: Douze, Matthijs, et al.
Publicado: (2024)

Contextual Position Encoding: Learning to Count What's Important
por: Golovneva, Olga, et al.
Publicado: (2024)

Some things are more CRINGE than others: Iterative Preference Optimization with the Pairwise Cringe Loss
por: Xu, Jing, et al.
Publicado: (2023)

Reverse Training to Nurse the Reversal Curse
por: Golovneva, Olga, et al.
Publicado: (2024)

Self-Challenging Language Model Agents
por: Zhou, Yifei, et al.
Publicado: (2025)

Thinking LLMs: General Instruction Following with Thought Generation
por: Wu, Tianhao, et al.
Publicado: (2024)

Iterative Reasoning Preference Optimization
por: Pang, Richard Yuanzhe, et al.
Publicado: (2024)

RLEF: Grounding Code LLMs in Execution Feedback with Reinforcement Learning
por: Gehring, Jonas, et al.
Publicado: (2024)

StepWiser: Stepwise Generative Judges for Wiser Reasoning
por: Xiong, Wei, et al.
Publicado: (2025)

R.I.P.: Better Models by Survival of the Fittest Prompts
por: Yu, Ping, et al.
Publicado: (2025)

Self-Rewarding Language Models
por: Yuan, Weizhe, et al.
Publicado: (2024)

Meta-Rewarding Language Models: Self-Improving Alignment with LLM-as-a-Meta-Judge
por: Wu, Tianhao, et al.
Publicado: (2024)

Functional Invariants to Watermark Large Transformers
por: Fernandez, Pierre, et al.
Publicado: (2023)

CoT-Self-Instruct: Building high-quality synthetic prompts for reasoning and non-reasoning tasks
por: Yu, Ping, et al.
Publicado: (2025)

Simple and Controllable Music Generation
por: Copet, Jade, et al.
Publicado: (2023)

Automatic Textbook Formalization
por: Gloeckle, Fabian, et al.
Publicado: (2026)

SWE-RL: Advancing LLM Reasoning via Reinforcement Learning on Open Software Evolution
por: Wei, Yuxiang, et al.
Publicado: (2025)

Self-Consistency Preference Optimization
por: Prasad, Archiki, et al.
Publicado: (2024)

Masked Audio Generation using a Single Non-Autoregressive Transformer
por: Ziv, Alon, et al.
Publicado: (2024)

Watermarking Makes Language Models Radioactive
por: Sander, Tom, et al.
Publicado: (2024)

Multi-Token Attention
por: Golovneva, Olga, et al.
Publicado: (2025)

Branch-Train-MiX: Mixing Expert LLMs into a Mixture-of-Experts LLM
por: Sukhbaatar, Sainbayar, et al.
Publicado: (2024)

Dualformer: Controllable Fast and Slow Thinking by Learning with Randomized Reasoning Traces
por: Su, DiJia, et al.
Publicado: (2024)

Moshi: a speech-text foundation model for real-time dialogue
por: Défossez, Alexandre, et al.
Publicado: (2024)

Beyond A*: Better Planning with Transformers via Search Dynamics Bootstrapping
por: Lehnert, Lucas, et al.
Publicado: (2024)

Self-Improving Pretraining: using post-trained models to pretrain better models
por: Tan, Ellen Xiaoqing, et al.
Publicado: (2026)

BigO(Bench) -- Can LLMs Generate Code with Controlled Time and Space Complexity?
por: Chambon, Pierre, et al.
Publicado: (2025)

Neutral Residues: Revisiting Adapters for Model Extension
por: Talla, Franck Signe, et al.
Publicado: (2024)

Machine learning and high dimensional vector search
por: Douze, Matthijs
Publicado: (2025)

AI & Human Co-Improvement for Safer Co-Superintelligence
por: Weston, Jason, et al.
Publicado: (2025)

RA-DIT: Retrieval-Augmented Dual Instruction Tuning
por: Lin, Xi Victoria, et al.
Publicado: (2023)

Step-KTO: Optimizing Mathematical Reasoning through Stepwise Binary Feedback
por: Lin, Yen-Ting, et al.
Publicado: (2025)

An Independence-promoting Loss for Music Generation with Language Models
por: Lemercier, Jean-Marie, et al.
Publicado: (2024)

Touring sampling with pushforward maps
por: Cabannes, Vivien, et al.
Publicado: (2023)

The Galerkin method beats Graph-Based Approaches for Spectral Algorithms
por: Cabannes, Vivien, et al.
Publicado: (2023)

In-context Pretraining: Language Modeling Beyond Document Boundaries
por: Shi, Weijia, et al.
Publicado: (2023)