Imagen de Portada

Frac-Connections: Fractional Extension of Hyper-Connections

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Zhu, Defa, Huang, Hongzhi, Zhou, Jundong, Huang, Zihao, Zeng, Yutao, Wu, Banggu, Min, Qiyang, Zhou, Xun
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning Artificial Intelligence Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Hyper-Connections
por: Zhu, Defa, et al.
Publicado: (2024)

Over-Tokenized Transformer: Vocabulary is Generally Worth Scaling
por: Huang, Hongzhi, et al.
Publicado: (2025)

Expert Race: A Flexible Routing Strategy for Scaling Diffusion Transformer with Mixture of Experts
por: Yuan, Yike, et al.
Publicado: (2025)

Ultra-Sparse Memory Network
por: Huang, Zihao, et al.
Publicado: (2024)

mHC: Manifold-Constrained Hyper-Connections
por: Xie, Zhenda, et al.
Publicado: (2025)

UltraMemV2: Memory Networks Scaling to 120B Parameters with Superior Long-Context Learning
por: Huang, Zihao, et al.
Publicado: (2025)

Polynomial Composition Activations: Unleashing the Dynamics of Large Language Models
por: Zhuo, Zhijian, et al.
Publicado: (2024)

Implicit Reward as the Bridge: A Unified View of SFT and DPO Connections
por: Wang, Bo, et al.
Publicado: (2025)

HybridNorm: Towards Stable and Efficient Transformer Training via Hybrid Normalization
por: Zhuo, Zhijian, et al.
Publicado: (2025)

HyperDAS: Towards Automating Mechanistic Interpretability with Hypernetworks
por: Sun, Jiuding, et al.
Publicado: (2025)

Textual Aesthetics in Large Language Models
por: Jiang, Lingjie, et al.
Publicado: (2024)

Multi-Head Mixture-of-Experts
por: Wu, Xun, et al.
Publicado: (2024)

Are Transformers Able to Reason by Connecting Separated Knowledge in Training Data?
por: Yin, Yutong, et al.
Publicado: (2025)

Solo Connection: A Parameter Efficient Fine-Tuning Technique for Transformers
por: Pathak, Harsh Nilesh, et al.
Publicado: (2025)

HyperSteer: Activation Steering at Scale with Hypernetworks
por: Sun, Jiuding, et al.
Publicado: (2025)

MUDDFormer: Breaking Residual Bottlenecks in Transformers via Multiway Dynamic Dense Connections
por: Xiao, Da, et al.
Publicado: (2025)

From Accuracy to Robustness: A Study of Rule- and Model-based Verifiers in Mathematical Reasoning
por: Huang, Yuzhen, et al.
Publicado: (2025)

Scaling DPPs for RAG: Density Meets Diversity
por: Sun, Xun, et al.
Publicado: (2026)

A Survey of Quantized Graph Representation Learning: Connecting Graph Structures with Large Language Models
por: Lin, Qika, et al.
Publicado: (2025)

How to Connect Speech Foundation Models and Large Language Models? What Matters and What Does Not
por: Verdini, Francesco, et al.
Publicado: (2024)

Connecting the Dots: LLMs can Infer and Verbalize Latent Structure from Disparate Training Data
por: Treutlein, Johannes, et al.
Publicado: (2024)

KromHC: Manifold-Constrained Hyper-Connections with Kronecker-Product Residual Matrices
por: Zhou, Wuyang, et al.
Publicado: (2026)

HyperMLP: An Integrated Perspective for Sequence Modeling
por: Lu, Jiecheng, et al.
Publicado: (2026)

DiLoCoX: A Low-Communication Large-Scale Training Framework for Decentralized Cluster
por: Qi, Ji, et al.
Publicado: (2025)

Deja vu: Contrastive Historical Modeling with Prefix-tuning for Temporal Knowledge Graph Reasoning
por: Peng, Miao, et al.
Publicado: (2024)

Transformers Can Learn Connectivity in Some Graphs but Not Others
por: Roy, Amit, et al.
Publicado: (2025)

DOCCI: Descriptions of Connected and Contrasting Images
por: Onoe, Yasumasa, et al.
Publicado: (2024)

A Case Study of Selected PTQ Baselines for Reasoning LLMs on Ascend NPU
por: Luo, Yuchen, et al.
Publicado: (2026)

CoSPlay: Cooperative Self-Play at Test-Time with Self-Generated Code and Unit Test
por: Hu, Zhangyi, et al.
Publicado: (2026)

SkillNet: Create, Evaluate, and Connect AI Skills
por: Liang, Yuan, et al.
Publicado: (2026)

AgroLLM: Connecting Farmers and Agricultural Practices through Large Language Models for Enhanced Knowledge Transfer and Practical Application
por: Samuel, Dinesh Jackson, et al.
Publicado: (2025)

An Analysis of Hyper-Parameter Optimization Methods for Retrieval Augmented Generation
por: Orbach, Matan, et al.
Publicado: (2025)

Sequential Large Language Model-Based Hyper-parameter Optimization
por: Mahammadli, Kanan, et al.
Publicado: (2024)

Tool-Star: Empowering LLM-Brained Multi-Tool Reasoner via Reinforcement Learning
por: Dong, Guanting, et al.
Publicado: (2025)

Efficient Prompt Optimization Through the Lens of Best Arm Identification
por: Shi, Chengshuai, et al.
Publicado: (2024)

Probing to Refine: Reinforcement Distillation of LLMs via Explanatory Inversion
por: Tan, Zhen, et al.
Publicado: (2026)

Token-Level LLM Collaboration via FusionRoute
por: Xiong, Nuoya, et al.
Publicado: (2026)

Ablate and Rescue: A Causal Analysis of Residual Stream Hyper-Connections
por: Peng, William, et al.
Publicado: (2026)

To Think or Not to Think: Exploring the Unthinking Vulnerability in Large Reasoning Models
por: Zhu, Zihao, et al.
Publicado: (2025)

Each Graph is a New Language: Graph Learning with LLMs
por: Zhou, Huachi, et al.
Publicado: (2025)