Copertina

Towards a theory of model distillation

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autore principale:	Boix-Adsera, Enric
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Artificial Intelligence Neural and Evolutionary Computing
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Equation discovery framework EPDE: Towards a better equation discovery
di: Maslyaev, Mikhail, et al.
Pubblicazione: (2024)

Towards White Box Deep Learning
di: Satkiewicz, Maciej
Pubblicazione: (2024)

Towards Physical Plausibility in Neuroevolution Systems
di: Cortês, Gabriel, et al.
Pubblicazione: (2024)

Spacer: Towards Engineered Scientific Inspiration
di: Lee, Minhyeong, et al.
Pubblicazione: (2025)

Interpolating neural network: A novel unification of machine learning and interpolation theory
di: Park, Chanwook, et al.
Pubblicazione: (2024)

Towards Foundation Models for Consensus Rank Aggregation
di: Jin, Yijun, et al.
Pubblicazione: (2026)

Q-S5: Towards Quantized State Space Models
di: Abreu, Steven, et al.
Pubblicazione: (2024)

Memory Networks: Towards Fully Biologically Plausible Learning
di: Ruiz, Jacobo, et al.
Pubblicazione: (2024)

Beyond Attention: Toward Machines with Intrinsic Higher Mental States
di: Adeel, Ahsan
Pubblicazione: (2025)

Toward Efficient Deep Spiking Neuron Networks:A Survey On Compression
di: Xie, Hui, et al.
Pubblicazione: (2024)

Towards graph neural networks for provably solving convex optimization problems
di: Qian, Chendi, et al.
Pubblicazione: (2025)

Towards evolution of Deep Neural Networks through contrastive Self-Supervised learning
di: Vinhas, Adriano, et al.
Pubblicazione: (2024)

Recursive Dynamics in Fast-Weights Homeostatic Reentry Networks: Toward Reflective Intelligence
di: Chae, B. G.
Pubblicazione: (2025)

Toward End-to-End Bearing Fault Diagnosis for Industrial Scenarios with Spiking Neural Networks
di: Zuo, Lin, et al.
Pubblicazione: (2024)

Towards Universal Offline Black-Box Optimization via Learning Language Model Embeddings
di: Tan, Rong-Xi, et al.
Pubblicazione: (2025)

Test-time regression: a unifying framework for designing sequence models with associative memory
di: Wang, Ke Alexander, et al.
Pubblicazione: (2025)

State-space models can learn in-context by gradient descent
di: Sushma, Neeraj Mohan, et al.
Pubblicazione: (2024)

Evolutionary fine tuning of quantized convolution-based deep learning models
di: Pietroń, Marcin
Pubblicazione: (2026)

ActPC-Geom: Towards Scalable Online Neural-Symbolic Learning via Accelerating Active Predictive Coding with Information Geometry & Diverse Cognitive Mechanisms
di: Goertzel, Ben
Pubblicazione: (2025)

DEBUG-HD: Debugging TinyML models on-device using Hyper-Dimensional computing
di: Ghanathe, Nikhil P, et al.
Pubblicazione: (2024)

Comparative study of clustering models for multivariate time series from connected medical devices
di: Courrier, Violaine, et al.
Pubblicazione: (2023)

A binary PSO based ensemble under-sampling model for rebalancing imbalanced training data
di: Li, Jinyan, et al.
Pubblicazione: (2025)

Towards Human-Like Driving: Active Inference in Autonomous Vehicle Control
di: Delavari, Elahe, et al.
Pubblicazione: (2024)

Mergenetic: a Simple Evolutionary Model Merging Library
di: Minut, Adrian Robert, et al.
Pubblicazione: (2025)

Learning under noisy supervision is governed by a feedback-truth gap
di: Schonfeld, Elan, et al.
Pubblicazione: (2026)

Optuna vs Code Llama: Are LLMs a New Paradigm for Hyperparameter Tuning?
di: Kochnev, Roman, et al.
Pubblicazione: (2025)

Improved Forecasting Using a PSO-RDV Framework to Enhance Artificial Neural Network
di: Aribe Jr, Sales
Pubblicazione: (2024)

Enhancing Cross Entropy with a Linearly Adaptive Loss Function for Optimized Classification Performance
di: Shim, Jae Wan
Pubblicazione: (2025)

Geometric Monomial (GEM): a family of rational 2N-differentiable activation functions
di: Krause, Eylon E.
Pubblicazione: (2026)

Long-only cryptocurrency portfolio management by ranking the assets: a neural network approach
di: Yang, Zijiang
Pubblicazione: (2025)

CLASSP: a Biologically-Inspired Approach to Continual Learning through Adjustment Suppression and Sparsity Promotion
di: Ludwig, Oswaldo
Pubblicazione: (2024)

Evolutionary Developmental Biology Can Serve as the Conceptual Foundation for a New Design Paradigm in Artificial Intelligence
di: Erden, Zeki Doruk, et al.
Pubblicazione: (2025)

Decoding Listeners Identity: Person Identification from EEG Signals Using a Lightweight Spiking Transformer
di: Lin, Zheyuan, et al.
Pubblicazione: (2025)

A Gauge Theory of Superposition: Toward a Sheaf-Theoretic Atlas of Neural Representations
di: Javidnia, Hossein
Pubblicazione: (2026)

Learning mental states estimation through self-observation: a developmental synergy between intentions and beliefs representations in a deep-learning model of Theory of Mind
di: Bianco, Francesca, et al.
Pubblicazione: (2024)

Secret mixtures of experts inside your LLM
di: Boix-Adsera, Enric
Pubblicazione: (2025)

On the inductive bias of infinite-depth ResNets and the bottleneck rank
di: Boix-Adsera, Enric
Pubblicazione: (2025)

CoEvo: Continual Evolution of Symbolic Solutions Using Large Language Models
di: Guo, Ping, et al.
Pubblicazione: (2024)

A Learn-to-Optimize Approach for Coordinate-Wise Step Sizes for Quasi-Newton Methods
di: Lin, Wei, et al.
Pubblicazione: (2024)

Reconsidering the energy efficiency of spiking neural networks
di: Yan, Zhanglu, et al.
Pubblicazione: (2024)