Cover Image

LoGAH: Predicting 774-Million-Parameter Transformers using Graph HyperNetworks with 1/100 Parameters

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhou, Xinyu, Knyazev, Boris, Jolicoeur-Martineau, Alexia, Fu, Jie
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Less is More: Recursive Reasoning with Tiny Networks
by: Jolicoeur-Martineau, Alexia
Published: (2025)

Any-Property-Conditional Molecule Generation with Self-Criticism using Spanning Trees
by: Jolicoeur-Martineau, Alexia, et al.
Published: (2024)

Generating $π$-Functional Molecules Using STGG+ with Active Learning
by: Jolicoeur-Martineau, Alexia, et al.
Published: (2025)

PopulAtion Parameter Averaging (PAPA)
by: Jolicoeur-Martineau, Alexia, et al.
Published: (2023)

Multi-Agent Game Generation and Evaluation via Audio-Visual Recordings
by: Jolicoeur-Martineau, Alexia
Published: (2025)

Generating and Imputing Tabular Data via Diffusion and Flow-based Gradient-Boosted Trees
by: Jolicoeur-Martineau, Alexia, et al.
Published: (2023)

Generating Tabular Data Using Heterogeneous Sequential Feature Forest Flow Matching
by: Akazan, Ange-Clément, et al.
Published: (2024)

Variational Inference for Quantum HyperNetworks
by: Nepote, Luca, et al.
Published: (2025)

Sheaf HyperNetworks for Personalized Federated Learning
by: Nguyen, Bao, et al.
Published: (2024)

FedAGHN: Personalized Federated Learning with Attentive Graph HyperNetworks
by: Song, Jiarui, et al.
Published: (2025)

On the Sample Efficiency of Inverse Dynamics Models for Semi-Supervised Imitation Learning
by: Morin, Sacha, et al.
Published: (2026)

Quantum HyperNetworks: Training Binary Neural Networks in Quantum Superposition
by: Carrasquilla, Juan, et al.
Published: (2023)

HyperDreamBooth: HyperNetworks for Fast Personalization of Text-to-Image Models
by: Ruiz, Nataniel, et al.
Published: (2023)

HN-MVTS: HyperNetwork-based Multivariate Time Series Forecasting
by: Savchenko, Andrey, et al.
Published: (2025)

Probabilistic Tiny Recursive Model
by: Sghaier, Amin, et al.
Published: (2026)

Multi-Sensor Matching with HyperNetworks
by: Passov, Eli, et al.
Published: (2026)

Hyper-GoalNet: Goal-Conditioned Manipulation Policy Learning with HyperNetworks
by: Zhou, Pei, et al.
Published: (2025)

Beyond FVD: Enhanced Evaluation Metrics for Video Generation Quality
by: Luo, Ge Ya, et al.
Published: (2024)

One Pass Is Not Enough: Recursive Latent Refinement for Generative Models
by: Esmaeilzadeh, Mehdi, et al.
Published: (2026)

On the Scaling of PEFT: Towards Million Personal Models of Trillion Parameters
by: Lab, Mind, et al.
Published: (2026)

Differential Evolution Algorithm based Hyper-Parameters Selection of Transformer Neural Network Model for Load Forecasting
by: Sen, Anuvab, et al.
Published: (2023)

Is Hyper-Parameter Optimization Different for Software Analytics?
by: Yedida, Rahul, et al.
Published: (2024)

Conditional LoRA Parameter Generation
by: Jin, Xiaolong, et al.
Published: (2024)

Understanding Adam Requires Better Rotation Dependent Assumptions
by: Zhang, Tianyue H., et al.
Published: (2024)

Large Language Model Agent for Hyper-Parameter Optimization
by: Liu, Siyi, et al.
Published: (2024)

HyperTTS: Parameter Efficient Adaptation in Text to Speech using Hypernetworks
by: Li, Yingting, et al.
Published: (2024)

GaLoRA: Parameter-Efficient Graph-Aware LLMs for Node Classification
by: Choudhary, Mayur, et al.
Published: (2026)

Sublinear Variational Optimization of Gaussian Mixture Models with Millions to Billions of Parameters
by: Salwig, Sebastian, et al.
Published: (2025)

Celo2: Towards Learned Optimization Free Lunch
by: Moudgil, Abhinav, et al.
Published: (2026)

Enhancing Speech Emotion Recognition via Fine-Tuning Pre-Trained Models and Hyper-Parameter Optimisation
by: Golbaghi, Aryan, et al.
Published: (2025)

HyperINF: Unleashing the HyperPower of the Schulz's Method for Data Influence Estimation
by: Zhou, Xinyu, et al.
Published: (2024)

Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRA
by: Bae, Sangmin, et al.
Published: (2024)

Allocation of Parameters in Transformers
by: Yu, Ruoxi, et al.
Published: (2025)

LoRA-drop: Efficient LoRA Parameter Pruning based on Output Evaluation
by: Zhou, Hongyun, et al.
Published: (2024)

An Analysis of Hyper-Parameter Optimization Methods for Retrieval Augmented Generation
by: Orbach, Matan, et al.
Published: (2025)

A Multi-objective Newton Optimization Algorithm for Hyper-Parameter Search
by: Xu, Qinwu
Published: (2024)

QAOA Parameter Transferability for Maximum Independent Set using Graph Attention Networks
by: Xu, Hanjing, et al.
Published: (2025)

Hyper-VolTran: Fast and Generalizable One-Shot Image to 3D Object Structure via HyperNetworks
by: Simon, Christian, et al.
Published: (2023)

A Federated Parameter Aggregation Method for Node Classification Tasks with Different Graph Network Structures
by: Song, Hao, et al.
Published: (2024)

Semantic-guided LoRA Parameters Generation
by: Li, Miaoge, et al.
Published: (2025)