Copertina

Scalable MatMul-free Language Modeling

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zhu, Rui-Jie, Zhang, Yu, Abreu, Steven, Sifferman, Ethan, Sheaves, Tyler, Wang, Yiqiao, Richmond, Dustin, Shrestha, Sumit Bam, Zhou, Peng, Eshraghian, Jason K.
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Neuromorphic Principles for Efficient Large Language Models on Intel Loihi 2
di: Abreu, Steven, et al.
Pubblicazione: (2025)

Assessing Tenstorrent's RISC-V MatMul Acceleration Capabilities
di: Cavagna, Hiari Pizzini, et al.
Pubblicazione: (2025)

Pushing Tensor Accelerators Beyond MatMul in a User-Schedulable Language
di: Zhang, Yihong, et al.
Pubblicazione: (2025)

Changing Base Without Losing Pace: A GPU-Efficient Alternative to MatMul in DNNs
di: Ailon, Nir, et al.
Pubblicazione: (2025)

Chameleon: A MatMul-Free Temporal Convolutional Network Accelerator for End-to-End Few-Shot and Continual Learning from Sequential Data
di: Blanken, Douwe den, et al.
Pubblicazione: (2025)

A Compute and Communication Runtime Model for Loihi 2
di: Timcheck, Jonathan, et al.
Pubblicazione: (2026)

Accelerating Linear Recurrent Neural Networks for the Edge with Unstructured Sparsity
di: Pierro, Alessandro, et al.
Pubblicazione: (2025)

Reducing Data Bottlenecks in Distributed, Heterogeneous Neural Networks
di: Lin, Ruhai, et al.
Pubblicazione: (2024)

SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networks
di: Zhu, Rui-Jie, et al.
Pubblicazione: (2023)

Transformers with Selective Access to Early Representations
di: Gunasekaran, Skye, et al.
Pubblicazione: (2026)

Emulating Brain-like Rapid Learning in Neuromorphic Edge Computing
di: Stewart, Kenneth, et al.
Pubblicazione: (2024)

A Systematic Analysis of Hybrid Linear Attention
di: Wang, Dustin, et al.
Pubblicazione: (2025)

Autonomous Driving with Spiking Neural Networks
di: Zhu, Rui-Jie, et al.
Pubblicazione: (2024)

Direct Semantic Communication Between Large Language Models via Vector Translation
di: Yang, Fu-Chun, et al.
Pubblicazione: (2025)

Autonomous Reinforcement Learning Robot Control with Intel's Loihi 2 Neuromorphic Hardware
di: Stewart, Kenneth, et al.
Pubblicazione: (2025)

Particulate Thorium-234 activity along the equatorial Atlantic collected on RV METEOR during cruise M181 Cape Town - Mindelo, 2022-04-17 - 2022-05-27
di: Bam, Wokil
Pubblicazione: (2026)

Total Thorium-234 Activity in water column along the equatorial Atlantic collected on RV METEOR during cruise M181 Cape Town - Mindelo, 2022-04-17 - 2022-05-27
di: Bam, Wokil
Pubblicazione: (2026)

Region Masking to Accelerate Video Processing on Neuromorphic Hardware
di: Sarkar, Sreetama, et al.
Pubblicazione: (2025)

FPIA: Field-Programmable Ising Arrays with In-Memory Computing
di: Hutchinson, George Higgins, et al.
Pubblicazione: (2024)

Surgical Gym: A high-performance GPU-based platform for reinforcement learning with surgical robots
di: Schmidgall, Samuel, et al.
Pubblicazione: (2023)

ARFlow: Autoregressive Flow with Hybrid Linear Attention
di: Hui, Mude, et al.
Pubblicazione: (2025)

A Predictive Approach To Enhance Time-Series Forecasting
di: Gunasekaran, Skye, et al.
Pubblicazione: (2024)

A Diagonal Structured State Space Model on Loihi 2 for Efficient Streaming Sequence Processing
di: Meyer, Svea Marie, et al.
Pubblicazione: (2024)

SQUAT: Stateful Quantization-Aware Training in Recurrent Spiking Neural Networks
di: Venkatesh, Sreyes, et al.
Pubblicazione: (2024)

Efficient Detection of Objects Near a Robot Manipulator via Miniature Time-of-Flight Sensors
di: Sifferman, Carter, et al.
Pubblicazione: (2025)

IKLink: End-Effector Trajectory Tracking with Minimal Reconfigurations
di: Wang, Yeping, et al.
Pubblicazione: (2024)

Exploiting Task Tolerances in Mimicry-based Telemanipulation
di: Wang, Yeping, et al.
Pubblicazione: (2023)

Boosting General Trimap-free Matting in the Real-World Image
di: Zhao, Leo Shan Wenzhang Zhou Grace
Pubblicazione: (2024)

SynA-ResNet: Spike-driven ResNet Achieved through OR Residual Connection
di: Shan, Yimeng, et al.
Pubblicazione: (2023)

Advancing Spiking Neural Networks towards Multiscale Spatiotemporal Interaction Learning
di: Shan, Yimeng, et al.
Pubblicazione: (2024)

Investigating Vision-Language Model for Point Cloud-based Vehicle Classification
di: Li, Yiqiao, et al.
Pubblicazione: (2025)

F I G U R E 3 in Summarising 40 years of gastric lavage studies to evaluate efficiency and survival in sharks and rays
di: Myers, Jaelen, et al.
Pubblicazione: (2025)

Die Cerambyciden-Gattung Mallosia Muls
di: NA
Pubblicazione: (1904)

MulVul: Retrieval-augmented Multi-Agent Code Vulnerability Detection via Cross-Model Prompt Evolution
di: Wu, Zihan, et al.
Pubblicazione: (2026)

Bridging the Modality Gap in Roadside LiDAR: A Training-Free Vision-Language Model Framework for Vehicle Classification
di: Li, Yiqiao, et al.
Pubblicazione: (2026)

MulDimIF: A Multi-Dimensional Constraint Framework for Evaluating and Improving Instruction Following in Large Language Models
di: Ye, Junjie, et al.
Pubblicazione: (2025)

Limax agrestis var. reticulata Mul. in Britain
di: Roebuck, William Denison
Pubblicazione: (1884)

DiffuMatting: Synthesizing Arbitrary Objects with Matting-level Annotation
di: Hu, Xiaobin, et al.
Pubblicazione: (2024)

Using a Distance Sensor to Detect Deviations in a Planar Surface
di: Sifferman, Carter, et al.
Pubblicazione: (2024)

MulChain: Enabling Advanced Cross-Modal Queries in Hybrid-Storage Blockchains
di: Peng, Zhiyuan, et al.
Pubblicazione: (2025)