Cover Image

Growing Tiny Networks: Spotting Expressivity Bottlenecks and Fixing Them Optimally

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Verbockhaven, Manon, Chevallier, Sylvain, Charpiat, Guillaume, Rudkiewicz, Théo
Format:	Preprint
Published:	2024
Subjects:	Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Growth strategies for arbitrary DAG neural architectures
by: Douka, Stella, et al.
Published: (2025)

Time and State Dependent Neural Delay Differential Equations
by: Monsel, Thibault, et al.
Published: (2023)

Neural delay differential equations: learning non-Markovian closures for partially known dynamical systems
by: Monsel, Thibault, et al.
Published: (2024)

Fine-Tuning Strategies for Continual Online EEG Motor Imagery Decoding: Insights from a Large-Scale Longitudinal Study
by: Wimpff, Martin, et al.
Published: (2025)

Hoeffding Concept Bottleneck Models with Applications to Overhead Images
by: Bénard, Clément, et al.
Published: (2026)

KWT-Tiny: RISC-V Accelerated, Embedded Keyword Spotting Transformer
by: Al-Qawlaq, Aness, et al.
Published: (2024)

MLGIB: Multi-Label Graph Information Bottleneck for Expressive and Robust Message Passing
by: Wu, Chaokai, et al.
Published: (2026)

Diverse LLMs vs. Vulnerabilities: Who Detects and Fixes Them Better?
by: Zibaeirad, Arastoo, et al.
Published: (2025)

Towards Contactless Elevators with TinyML using CNN-based Person Detection and Keyword Spotting
by: Pimpalkar, Anway S., et al.
Published: (2024)

An Implicit GNN Solver for Poisson-like problems
by: Nastorg, Matthieu, et al.
Published: (2023)

TinyAlign: Boosting Lightweight Vision-Language Models by Mitigating Modal Alignment Bottlenecks
by: Hu, Yuanze, et al.
Published: (2025)

Semantic Differentiation in Speech Emotion Recognition: Insights from Descriptive and Expressive Speech Roles
by: Guo, Rongchen, et al.
Published: (2025)

Less is More: Recursive Reasoning with Tiny Networks
by: Jolicoeur-Martineau, Alexia
Published: (2025)

On the Expressive Power of Graph Neural Networks
by: Nalwade, Ashwin, et al.
Published: (2024)

"Over-the-Hood" AI Inclusivity Bugs and How 3 AI Product Teams Found and Fixed Them
by: Anderson, Andrew, et al.
Published: (2025)

Is Best-of-N the Best of Them? Coverage, Scaling, and Optimality in Inference-Time Alignment
by: Huang, Audrey, et al.
Published: (2025)

Probabilistic Tiny Recursive Model
by: Sghaier, Amin, et al.
Published: (2026)

Tiny-QMoE
by: Cashman, Jack, et al.
Published: (2025)

The Causal Information Bottleneck and Optimal Causal Variable Abstractions
by: Simoes, Francisco N. F. Q., et al.
Published: (2024)

Assessing the Impact of Anisotropy in Neural Representations of Speech: A Case Study on Keyword Spotting
by: Wisniewski, Guillaume, et al.
Published: (2025)

Discovering the Representation Bottleneck of Graph Neural Networks
by: Wu, Fang, et al.
Published: (2022)

The Illusion of Role Separation: Hidden Shortcuts in LLM Role Learning (and How to Fix Them)
by: Wang, Zihao, et al.
Published: (2025)

How to Square Tensor Networks and Circuits Without Squaring Them
by: Loconte, Lorenzo, et al.
Published: (2025)

Deep Optimal Transport: A Practical Algorithm for Photo-realistic Image Restoration
by: Adrai, Theo, et al.
Published: (2023)

Tiny Reward Models
by: Pan, Sarah
Published: (2025)

Enhancing Logical Expressiveness in Graph Neural Networks via Path-Neighbor Aggregation
by: Yu, Han, et al.
Published: (2025)

Data Classification with Dynamically Growing and Shrinking Neural Networks
by: Świderski, Szymon, et al.
Published: (2025)

TinyGraph: Joint Feature and Node Condensation for Graph Neural Networks
by: Liu, Yezi, et al.
Published: (2024)

EcoSearch: A Constant-Delay Best-First Search Algorithm for Program Synthesis
by: Matricon, Théo, et al.
Published: (2024)

Safe for Whom? Rethinking How We Evaluate the Safety of LLMs for Real Users
by: Kempermann, Manon, et al.
Published: (2025)

Tiny Models are the Computational Saver for Large Models
by: Wang, Qingyuan, et al.
Published: (2024)

Visual Instruction Bottleneck Tuning
by: Oh, Changdae, et al.
Published: (2025)

Hidden markov model to predict tourists visited place
by: Demessance, Theo, et al.
Published: (2025)

AraSpot: Arabic Spoken Command Spotting
by: Salhab, Mahmoud, et al.
Published: (2023)

Expressiveness of Multi-Neuron Convex Relaxations in Neural Network Certification
by: Mao, Yuhao, et al.
Published: (2024)

Boosting Graph Neural Network Expressivity with Learnable Lanczos Constraints
by: Azizi, Niloofar, et al.
Published: (2024)

Learning Expressive Priors for Generalization and Uncertainty Estimation in Neural Networks
by: Schnaus, Dominik, et al.
Published: (2023)

The Interaction Bottleneck of Deep Neural Networks: Discovery, Proof, and Modulation
by: Deng, Huiqi, et al.
Published: (2025)

Optimizing Genetic Algorithms with Multilayer Perceptron Networks for Enhancing TinyFace Recognition
by: Al-Batah, Mohammad Subhi, et al.
Published: (2025)

Bounded Fitting for Expressive Description Logics
by: Funk, Maurice, et al.
Published: (2026)