Cover Image

Efficient Neural Networks with Discrete Cosine Transform Activations

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Martinez-Gost, Marc, Pepe, Sara, Pérez-Neira, Ana, Lagunas, Miguel Ángel
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Adaptive function approximation based on the Discrete Cosine Transform (DCT)
by: Pérez-Neira, Ana I., et al.
Published: (2023)

ENN: A Neural Network with DCT Adaptive Activation Functions
by: Martinez-Gost, Marc, et al.
Published: (2023)

Robust Over-the-Air Computation with Type-Based Multiple Access
by: Martinez-Gost, Marc, et al.
Published: (2025)

CosineGate: Semantic Dynamic Routing via Cosine Incompatibility in Residual Networks
by: Thota, Yogeswar Reddy
Published: (2025)

LoCA: Location-Aware Cosine Adaptation for Parameter-Efficient Fine-Tuning
by: Du, Zhekai, et al.
Published: (2025)

Efficient and Interpretable Neural Networks Using Complex Lehmer Transform
by: Ataei, Masoud, et al.
Published: (2025)

Before AI Takes Over: Rethinking Nonlinear Signal Processing in Communications
by: Pérez-Neira, Ana, et al.
Published: (2025)

Exponential Noise Robustness of Type-Based Multiple Access for Over-the-Air Computation
by: Martinez-Gost, Marc, et al.
Published: (2026)

Frequency Modulation Aggregation for Federated Learning
by: Martinez-Gost, Marc, et al.
Published: (2023)

Log-FSK: A Frequency Modulation for Over-the-Air Computation
by: Martinez-Gost, Marc, et al.
Published: (2024)

LoRa-based Over-the-Air Computing for Sat-IoT
by: Martinez-Gost, Marc, et al.
Published: (2023)

LoRa Modulation for Split Learning
by: Martinez-Gost, Marc, et al.
Published: (2023)

The DCT Neuron for Estimation and Compensation of Amplitude Distortions in OFDM Systems
by: Martinez-Gost, Marc, et al.
Published: (2026)

Expanding Over-the-Air Computation with Frequency Modulations
by: Martinez-Gost, Marc, et al.
Published: (2024)

Predictive Demodulation for Chaotic Communications
by: Martinez-Gost, Marc, et al.
Published: (2024)

Frequency Modulation for Task-Oriented Communications and Multiple Access
by: Martinez-Gost, Marc, et al.
Published: (2024)

Ray-Tracing for Conditionally Activated Neural Networks
by: Gallicchio, Claudio, et al.
Published: (2025)

Transformers are Graph Neural Networks
by: Joshi, Chaitanya K.
Published: (2025)

Learning from Historical Activations in Graph Neural Networks
by: Galron, Yaniv, et al.
Published: (2026)

APEX: Probing Neural Networks via Activation Perturbation
by: Ren, Tao, et al.
Published: (2026)

MaCP: Minimal yet Mighty Adaptation via Hierarchical Cosine Projection
by: Shen, Yixian, et al.
Published: (2025)

MaCP: Minimal yet Mighty Adaptation via Hierarchical Cosine Projection
by: Shen, Yixian, et al.
Published: (2024)

Parameter-Efficient Fine-Tuning with Discrete Fourier Transform
by: Gao, Ziqi, et al.
Published: (2024)

HorNets: Learning from Discrete and Continuous Signals with Routing Neural Networks
by: Koloski, Boshko, et al.
Published: (2025)

Deep Neural Networks as Discrete Dynamical Systems: Implications for Physics-Informed Learning
by: Ganguly, Abhisek, et al.
Published: (2026)

Probing Graph Neural Network Activation Patterns Through Graph Topology
by: Tori, Floriano, et al.
Published: (2026)

DeepACTIF: Efficient Feature Attribution via Activation Traces in Neural Sequence Models
by: Hosp, Benedikt W.
Published: (2025)

Developing Training Procedures for Piecewise-linear Spline Activation Functions in Neural Networks
by: Patty, William H
Published: (2025)

Graph Alignment for Benchmarking Graph Neural Networks and Learning Positional Encodings
by: Lagesse, Adrien, et al.
Published: (2025)

Massive Activations in Graph Neural Networks: Decoding Attention for Domain-Dependent Interpretability
by: Bini, Lorenzo, et al.
Published: (2024)

Emergence of Globally Attracting Fixed Points in Deep Neural Networks With Nonlinear Activations
by: Joudaki, Amir, et al.
Published: (2024)

The DCT Model as a Novel Regression Framework within a Lagrangian Formulation
by: Martinez-Gost, Marc, et al.
Published: (2026)

Advancing Constrained Monotonic Neural Networks: Achieving Universal Approximation Beyond Bounded Activations
by: Sartor, Davide, et al.
Published: (2025)

Combining Causal Models for More Accurate Abstractions of Neural Networks
by: Pîslar, Theodora-Mara, et al.
Published: (2025)

Discrete Diffusion Schrödinger Bridge Matching for Graph Transformation
by: Kim, Jun Hyeong, et al.
Published: (2024)

Simple and Efficient Heterogeneous Temporal Graph Neural Network
by: Wang, Yili, et al.
Published: (2025)

Dynamic Spectral Backpropagation for Efficient Neural Network Training
by: Muthuraman, Mannmohan
Published: (2025)

Rapfi: Distilling Efficient Neural Network for the Game of Gomoku
by: Jin, Zhanggen, et al.
Published: (2025)

Optimizing Dense Feed-Forward Neural Networks
by: Balderas, Luis, et al.
Published: (2023)

SeqBattNet: A Discrete-State Physics-Informed Neural Network with Aging Adaptation for Battery Modeling
by: Tran, Khoa, et al.
Published: (2025)