Cover Image

Grouped Differential Attention

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lim, Junghwan, Lee, Sungmin, Kim, Dongseok, Cheung, Wai Ting, Kim, Beomgyu, Kim, Taehwan, Lee, Haesol, Lee, Junhyeok, Oh, Dongpin, Park, Eunhwan
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Motif 2.6B Technical Report
by: Lim, Junghwan, et al.
Published: (2025)

Expanding Foundational Language Capabilities in Open-Source LLMs through a Korean Case Study
by: Lim, Junghwan, et al.
Published: (2025)

Motif 2 12.7B technical report
by: Lim, Junghwan, et al.
Published: (2025)

Motif-2-12.7B-Reasoning: A Practitioner's Guide to RL Training Recipes
by: Lim, Junghwan, et al.
Published: (2025)

Motif-Video 2B: Technical Report
by: Lim, Junghwan, et al.
Published: (2026)

A Ridge Too Far: Correcting Over-Shrinkage via Negative Regularization
by: Kim, Dongseok, et al.
Published: (2025)

Training-free LLM Verification via Recycling Few-shot Examples
by: Lee, Dongseok, et al.
Published: (2025)

Adversarial Reinforcement Learning Framework for ESP Cheater Simulation
by: Park, Inkyu, et al.
Published: (2025)

Are Self-Attentions Effective for Time Series Forecasting?
by: Kim, Dongbin, et al.
Published: (2024)

DiSPA: Differential Substructure-Pathway Attention for Drug Response Prediction
by: Han, Yewon, et al.
Published: (2026)

Data Descriptions from Large Language Models with Influence Estimation
by: Kim, Chaeri, et al.
Published: (2025)

TANDEM: Temporal Attention-guided Neural Differential Equations for Missingness in Time Series Classification
by: Oh, YongKyung, et al.
Published: (2025)

The Amazing Agent Race: Strong Tool Users, Weak Navigators
by: Kim, Zae Myung, et al.
Published: (2026)

Optimal trajectory-guided stochastic co-optimization for e-fuel system design and real-time operation
by: Kim, Jeongdong, et al.
Published: (2026)

Comprehensive Review of Neural Differential Equations for Time Series Analysis
by: Oh, YongKyung, et al.
Published: (2025)

Subgraph Federated Learning for Local Generalization
by: Kim, Sungwon, et al.
Published: (2025)

LaRA: Layer-wise Representation Analysis for Detecting Data Contamination in RL Post-Training
by: Gwak, Minju, et al.
Published: (2026)

CUBE: Contrastive Understanding by Balanced Experiments
by: Kim, Dongseok, et al.
Published: (2025)

Interpreting Attention Heads for Image-to-Text Information Flow in Large Vision-Language Models
by: Kim, Jinyeong, et al.
Published: (2025)

Stable Neural Stochastic Differential Equations in Analyzing Irregular Time Series Data
by: Oh, YongKyung, et al.
Published: (2024)

Label-based Graph Augmentation with Metapath for Graph Anomaly Detection
by: Kim, Hwan, et al.
Published: (2023)

Peri-LN: Revisiting Normalization Layer in the Transformer Architecture
by: Kim, Jeonghoon, et al.
Published: (2025)

Spurious Correlation-Aware Embedding Regularization for Worst-Group Robustness
by: Park, Subeen, et al.
Published: (2025)

Fair Clustering via Alignment
by: Kim, Kunwoong, et al.
Published: (2025)

FIRE: Frobenius-Isometry Reinitialization for Balancing the Stability-Plasticity Tradeoff
by: Han, Isaac, et al.
Published: (2026)

Two-Stage Grid Optimization for Group-wise Quantization of LLMs
by: Kim, Junhan, et al.
Published: (2026)

Attention-Based Neural-Augmented Kalman Filter for Legged Robot State Estimation
by: Lee, Seokju, et al.
Published: (2026)

BoA: Attention-aware Post-training Quantization without Backpropagation
by: Kim, Junhan, et al.
Published: (2024)

Adversarial Environment Design via Regret-Guided Diffusion Models
by: Chung, Hojun, et al.
Published: (2024)

Effective Test-Time Scaling of Discrete Diffusion through Iterative Refinement
by: Lee, Sanghyun, et al.
Published: (2025)

Disentangling Hyperedges through the Lens of Category Theory
by: Lee, Yoonho, et al.
Published: (2025)

Subspace-based Approximate Hessian Method for Zeroth-Order Optimization
by: Kim, Dongyoon, et al.
Published: (2025)

To Predict or Not To Predict? Proportionally Masked Autoencoders for Tabular Data Imputation
by: Kim, Jungkyu, et al.
Published: (2024)

DAMEL: Dual-Axis Multi-Expert Learning for Class-Imbalanced Learning
by: Lee, Hyuck, et al.
Published: (2026)

Contrast-CAT: Contrasting Activations for Enhanced Interpretability in Transformer-based Text Classifiers
by: Han, Sungmin, et al.
Published: (2025)

How Prompts Move Language Model Behavior: Frames, Salience, and Construal as Semantic Control
by: Kim, Dongseok, et al.
Published: (2025)

RingFormer: Rethinking Recurrent Transformer with Adaptive Level Signals
by: Heo, Jaemu, et al.
Published: (2025)

MaD-Scientist: AI-based Scientist solving Convection-Diffusion-Reaction Equations Using Massive PINN-Based Prior Data
by: Kang, Mingu, et al.
Published: (2024)

Lookahead Unmasking Elicits Accurate Decoding in Diffusion Language Models
by: Lee, Sanghyun, et al.
Published: (2025)

Fair Bayesian Model-Based Clustering
by: Lee, Jihu, et al.
Published: (2025)