Mamba base PKD for efficient knowledge compression
Fuente:
arXiv
Guardado en:
| Autores principales: | Medina, José, Hadachi, Amnir, Honeine, Paul, Bensrhair, Abdelaziz |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
SATORIS-N: Spectral Analysis based Traffic Observation Recovery via Informed Subspaces and Nuclear-norm minimization
por: Mohanty, Sampad, et al.
Publicado: (2026)
por: Mohanty, Sampad, et al.
Publicado: (2026)
The Spotlight Resonance Method: Resolving the Alignment of Embedded Activations
por: Bird, George
Publicado: (2025)
por: Bird, George
Publicado: (2025)
ZClassifier: Temperature Tuning and Manifold Approximation via KL Divergence on Logit Space
por: Yong, Shim Soon
Publicado: (2025)
por: Yong, Shim Soon
Publicado: (2025)
Learning to Land Anywhere: Transferable Generative Models for Aircraft Trajectories
por: Larsen, Olav Finne Praesteng, et al.
Publicado: (2025)
por: Larsen, Olav Finne Praesteng, et al.
Publicado: (2025)
Contrastive Representation Modeling for Anomaly Detection
por: Lunardi, Willian T., et al.
Publicado: (2025)
por: Lunardi, Willian T., et al.
Publicado: (2025)
AdaCap: An Adaptive Contrastive Approach for Small-Data Neural Networks
por: Belucci, Bruno, et al.
Publicado: (2025)
por: Belucci, Bruno, et al.
Publicado: (2025)
Efficient Action-Constrained Reinforcement Learning via Acceptance-Rejection Method and Augmented MDPs
por: Hung, Wei, et al.
Publicado: (2025)
por: Hung, Wei, et al.
Publicado: (2025)
Structured Contrastive Learning for Interpretable Latent Representations
por: Shen, Zhengyang, et al.
Publicado: (2025)
por: Shen, Zhengyang, et al.
Publicado: (2025)
AGOP-IxG: A Gradient Covariance Filter for Local Feature Attribution on Tabular Data, with a Controlled Benchmark
por: Katakam, Raj Kiran Gupta
Publicado: (2026)
por: Katakam, Raj Kiran Gupta
Publicado: (2026)
Nonparametric Partial Disentanglement via Mechanism Sparsity: Sparse Actions, Interventions and Sparse Temporal Dependencies
por: Lachapelle, Sébastien, et al.
Publicado: (2024)
por: Lachapelle, Sébastien, et al.
Publicado: (2024)
Giving Sensors a Voice: Multimodal JEPA for Semantic Time-Series Embeddings
por: Dutta, Utsav, et al.
Publicado: (2026)
por: Dutta, Utsav, et al.
Publicado: (2026)
Subspace Geometry Governs Catastrophic Forgetting in Low-Rank Adaptation
por: Steele, Brady
Publicado: (2026)
por: Steele, Brady
Publicado: (2026)
Feature emergence via margin maximization: case studies in algebraic tasks
por: Morwani, Depen, et al.
Publicado: (2023)
por: Morwani, Depen, et al.
Publicado: (2023)
Remaining Useful Life Estimation for Turbofan Engines: A Comparative Study of Classical, CNN, and LSTM Approaches
por: Goel, Astitva, et al.
Publicado: (2026)
por: Goel, Astitva, et al.
Publicado: (2026)
Entropy Aware Message Passing in Graph Neural Networks
por: Nazari, Philipp, et al.
Publicado: (2024)
por: Nazari, Philipp, et al.
Publicado: (2024)
Annot-Mix: Learning with Noisy Class Labels from Multiple Annotators via a Mixup Extension
por: Herde, Marek, et al.
Publicado: (2024)
por: Herde, Marek, et al.
Publicado: (2024)
In-situ Autoguidance: Eliciting Self-Correction in Diffusion Models
por: Gu, Enhao, et al.
Publicado: (2025)
por: Gu, Enhao, et al.
Publicado: (2025)
Listwise Direct Preference Optimization with Multi-Dimensional Preference Mixing
por: Sun, Yuhui, et al.
Publicado: (2025)
por: Sun, Yuhui, et al.
Publicado: (2025)
Emergence of Quantised Representations Isolated to Anisotropic Functions
por: Bird, George
Publicado: (2025)
por: Bird, George
Publicado: (2025)
Information-Theoretic Quality Metric of Low-Dimensional Embeddings
por: Gutiérrez-Bernal, Sebastián, et al.
Publicado: (2025)
por: Gutiérrez-Bernal, Sebastián, et al.
Publicado: (2025)
SeizureFormer: A Transformer Model for IEA-Based Seizure Risk Forecasting
por: Feng, Tianning, et al.
Publicado: (2025)
por: Feng, Tianning, et al.
Publicado: (2025)
Optimizing Latent Dimension Allocation in Hierarchical VAEs: Balancing Attenuation and Information Retention for OOD Detection
por: Williamson, Dane, et al.
Publicado: (2025)
por: Williamson, Dane, et al.
Publicado: (2025)
GCAD: Anomaly Detection in Multivariate Time Series from the Perspective of Granger Causality
por: Liu, Zehao, et al.
Publicado: (2025)
por: Liu, Zehao, et al.
Publicado: (2025)
Optimizing Robustness and Accuracy in Mixture of Experts: A Dual-Model Approach
por: Zhang, Xu, et al.
Publicado: (2025)
por: Zhang, Xu, et al.
Publicado: (2025)
Optimizing Inference in Transformer-Based Models: A Multi-Method Benchmark
por: Ho, Siu Hang, et al.
Publicado: (2025)
por: Ho, Siu Hang, et al.
Publicado: (2025)
Aggregating Direct and Indirect Neighbors through Graph Linear Transformations
por: Rosenhoover, Marshall, et al.
Publicado: (2025)
por: Rosenhoover, Marshall, et al.
Publicado: (2025)
Out of Distribution Detection for Efficient Continual Learning in Quality Prediction for Arc Welding
por: Hahn, Yannik, et al.
Publicado: (2025)
por: Hahn, Yannik, et al.
Publicado: (2025)
Step-E: A Differentiable Data Cleaning Framework for Robust Learning with Noisy Labels
por: Du, Wenzhang
Publicado: (2025)
por: Du, Wenzhang
Publicado: (2025)
QuIDE: Mastering the Quantized Intelligence Trade-off via Active Optimization
por: Jiang, Xiantao
Publicado: (2026)
por: Jiang, Xiantao
Publicado: (2026)
Explicit Dropout: Deterministic Regularization for Transformer Architectures
por: Agrawal, Vidhi, et al.
Publicado: (2026)
por: Agrawal, Vidhi, et al.
Publicado: (2026)
Towards Automated Diagnosis of Inherited Arrhythmias: Combined Arrhythmia Classification Using Lead-Aware Spatial Attention Networks
por: Sigfstead, Sophie, et al.
Publicado: (2026)
por: Sigfstead, Sophie, et al.
Publicado: (2026)
Neural Reasoning Networks: Efficient Interpretable Neural Networks With Automatic Textual Explanations
por: Carrow, Stephen, et al.
Publicado: (2024)
por: Carrow, Stephen, et al.
Publicado: (2024)
Massive Redundancy in Gradient Transport Enables Sparse Online Learning
por: Merin, Aur Shalev
Publicado: (2026)
por: Merin, Aur Shalev
Publicado: (2026)
Entropy Causal Graphs for Multivariate Time Series Anomaly Detection
por: Febrinanto, Falih Gozi, et al.
Publicado: (2023)
por: Febrinanto, Falih Gozi, et al.
Publicado: (2023)
Bayesian X-Learner: Calibrated Posterior Inference for Heterogeneous Treatment Effects under Heavy-Tailed Outcomes
por: Uehara, Eichi
Publicado: (2026)
por: Uehara, Eichi
Publicado: (2026)
DeepDTF: Dual-Branch Transformer Fusion for Multi-Omics Anticancer Drug Response Prediction
por: Zhao, Yuhan, et al.
Publicado: (2026)
por: Zhao, Yuhan, et al.
Publicado: (2026)
Binned semiparametric Bayesian networks for efficient kernel density estimation
por: Sojo, Rafael, et al.
Publicado: (2025)
por: Sojo, Rafael, et al.
Publicado: (2025)
Augmenting Replay in World Models for Continual Reinforcement Learning
por: Yang, Luke, et al.
Publicado: (2024)
por: Yang, Luke, et al.
Publicado: (2024)
Regularisation in neural networks: a survey and empirical analysis of approaches
por: Opperman, Christiaan P., et al.
Publicado: (2026)
por: Opperman, Christiaan P., et al.
Publicado: (2026)
Efficient Strategy for Improving Large Language Model (LLM) Capabilities
por: Gutiérrez, Julián Camilo Velandia
Publicado: (2025)
por: Gutiérrez, Julián Camilo Velandia
Publicado: (2025)
Ejemplares similares
-
SATORIS-N: Spectral Analysis based Traffic Observation Recovery via Informed Subspaces and Nuclear-norm minimization
por: Mohanty, Sampad, et al.
Publicado: (2026) -
The Spotlight Resonance Method: Resolving the Alignment of Embedded Activations
por: Bird, George
Publicado: (2025) -
ZClassifier: Temperature Tuning and Manifold Approximation via KL Divergence on Logit Space
por: Yong, Shim Soon
Publicado: (2025) -
Learning to Land Anywhere: Transferable Generative Models for Aircraft Trajectories
por: Larsen, Olav Finne Praesteng, et al.
Publicado: (2025) -
Contrastive Representation Modeling for Anomaly Detection
por: Lunardi, Willian T., et al.
Publicado: (2025)