Cover Image

Cross-Paradigm Knowledge Distillation: A Comprehensive Study of Bidirectional Transfer Between Random Forests and Deep Neural Networks for Big Data Applications

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Moghadasi, Mahdi Naser
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Agentic Cost-Aware Query Planning with Knowledge Distillation for Big Data Analytics
by: Naser-Moghadasi, Mahdi
Published: (2026)

Neural Activation Patterns Across Language Model Architectures: A Comprehensive Analysis of Cognitive Task Performance
by: Naser-Moghadasi, Mahdi, et al.
Published: (2026)

Transformer Scalability Crisis: The First Comprehensive Empirical Analysis of Performance Walls in Modern Language Models
by: Moghadasi, Mahdi Naser, et al.
Published: (2026)

On Explaining Knowledge Distillation: Measuring and Visualising the Knowledge Transfer Process
by: Adhane, Gereziher, et al.
Published: (2024)

Beyond Extrapolation: Knowledge Utilization Paradigm with Bidirectional Inspiration for Time Series Forecasting
by: Chong, Liu, et al.
Published: (2026)

A Unified Framework for Knowledge Transfer in Bidirectional Model Scaling
by: Shen, Jianlu, et al.
Published: (2026)

Neural Random Forest Imitation
by: Reinders, Christoph, et al.
Published: (2019)

Knowledge Distillation for Variational Quantum Convolutional Neural Networks on Heterogeneous Data
by: Yu, Kai, et al.
Published: (2025)

Modeling Electromagnetic Navigation Systems for Medical Applications using Random Forests and Artificial Neural Networks
by: Yu, Ruoxi, et al.
Published: (2019)

A Functional Perspective on Knowledge Distillation in Neural Networks
by: Mason-Williams, Israel, et al.
Published: (2025)

A Closer Look at Knowledge Distillation in Spiking Neural Network Training
by: Liu, Xu, et al.
Published: (2025)

Transfer Learning with Distance Covariance for Random Forest: Error Bounds and an EHR Application
by: Li, Chenze, et al.
Published: (2025)

Knowledge Distillation in Wide Neural Networks: Risk Bound, Data Efficiency and Imperfect Teacher
by: Ji, Guangda, et al.
Published: (2020)

Online Adversarial Knowledge Distillation for Graph Neural Networks
by: Wang, Can, et al.
Published: (2021)

Adversarial Curriculum Graph-Free Knowledge Distillation for Graph Neural Networks
by: Jia, Yuang, et al.
Published: (2025)

Dataset Distillation via Knowledge Distillation: Towards Efficient Self-Supervised Pre-Training of Deep Networks
by: Joshi, Siddharth, et al.
Published: (2024)

Bridging Classical and Quantum Machine Learning: Knowledge Transfer From Classical to Quantum Neural Networks Using Knowledge Distillation
by: Hasan, Mohammad Junayed, et al.
Published: (2023)

Synergy Between the Strong and the Weak: Spiking Neural Networks are Inherently Self-Distillers
by: Ding, Yongqi, et al.
Published: (2025)

Efficient Logit-based Knowledge Distillation of Deep Spiking Neural Networks for Full-Range Timestep Deployment
by: Yu, Chengting, et al.
Published: (2025)

Shifting the Paradigm: A Diffeomorphism Between Time Series Data Manifolds for Achieving Shift-Invariancy in Deep Learning
by: Demirel, Berken Utku, et al.
Published: (2025)

On the Equivalence of Random Network Distillation, Deep Ensembles, and Bayesian Inference
by: Zanger, Moritz A., et al.
Published: (2026)

Distill to Delete: Unlearning in Graph Networks with Knowledge Distillation
by: Sinha, Yash, et al.
Published: (2023)

Interpretable Network-assisted Random Forest+
by: Tang, Tiffany M., et al.
Published: (2025)

Principled Federated Random Forests for Heterogeneous Data
by: Khellaf, Rémi, et al.
Published: (2026)

Reservoir Computing: A New Paradigm for Neural Networks
by: Grezes, Felix
Published: (2025)

Distilled Circuits: A Mechanistic Study of Internal Restructuring in Knowledge Distillation
by: Haskins, Reilly, et al.
Published: (2025)

On the Relationship Between Representation Geometry and Generalization in Deep Neural Networks
by: Yadav, Sumit
Published: (2026)

RMT-KD: Random Matrix Theoretic Causal Knowledge Distillation
by: Ettori, Davide, et al.
Published: (2025)

Semantic-Cohesive Knowledge Distillation for Deep Cross-modal Hashing
by: Sun, Changchang, et al.
Published: (2025)

Federated Random Forest for Partially Overlapping Clinical Data
by: Park, Youngjun, et al.
Published: (2024)

Randomization Can Reduce Both Bias and Variance: A Case Study in Random Forests
by: Liu, Brian, et al.
Published: (2024)

HKT: A Biologically Inspired Framework for Modular Hereditary Knowledge Transfer in Neural Networks
by: Tchenko, Yanick Chistian, et al.
Published: (2025)

Enhancing Graph Neural Networks with Limited Labeled Data by Actively Distilling Knowledge from Large Language Models
by: Li, Quan, et al.
Published: (2024)

TuneShift-KD: Knowledge Distillation and Transfer for Fine-tuned Models
by: Guan, Yushi, et al.
Published: (2026)

Bidirectional Progressive Neural Networks with Episodic Return Progress for Emergent Task Sequencing and Robotic Skill Transfer
by: Ada, Suzan Ece, et al.
Published: (2024)

Towards Causal Classification: A Comprehensive Study on Graph Neural Networks
by: Job, Simi, et al.
Published: (2024)

Deep Neural Network Training as Random Effects: An Optimization-Inference Duality
by: Yao, Minhao, et al.
Published: (2026)

On the Relationship Between Adversarial Robustness and Decision Region in Deep Neural Networks
by: Park, Seongjin, et al.
Published: (2022)

Utilizing Graph Neural Networks for Effective Link Prediction in Microservice Architectures
by: Khodabandeh, Ghazal, et al.
Published: (2025)

RNAS-CL: Robust Neural Architecture Search by Cross-Layer Knowledge Distillation
by: Nath, Utkarsh, et al.
Published: (2023)