Cover Image

Representational Homomorphism Predicts and Improves Compositional Generalization In Transformer Language Model

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	An, Zhiyu, Du, Wan
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Open Problems in Differentiable Social Choice: Learning Mechanisms, Decisions, and Alignment
by: An, Zhiyu, et al.
Published: (2026)

Beyond Noisy-TVs: Noise-Robust Exploration Via Learning Progress Monitoring
by: Hou, Zhibo, et al.
Published: (2025)

Go Beyond Black-box Policies: Rethinking the Design of Learning Agent for Interpretable and Verifiable HVAC Control
by: An, Zhiyu, et al.
Published: (2024)

Improving Out-of-Distribution Generalization of Trajectory Prediction for Autonomous Driving via Polynomial Representations
by: Yao, Yue, et al.
Published: (2024)

Towards Unraveling and Improving Generalization in World Models
by: Fang, Qiaoyi, et al.
Published: (2024)

Using Forwards-Backwards Models to Approximate MDP Homomorphisms
by: Mavor-Parker, Augustine N., et al.
Published: (2022)

Adaptive Conformal Prediction for Improving Factuality of Generations by Large Language Models
by: Rubashevskii, Aleksandr, et al.
Published: (2026)

Geometric Representation Condition Improves Equivariant Molecule Generation
by: Li, Zian, et al.
Published: (2024)

SIPO: Stabilized and Improved Preference Optimization for Aligning Diffusion Models
by: Yang, Xiaomeng, et al.
Published: (2025)

Value-Aware Numerical Representations for Transformer Language Models
by: Dutulescu, Andreea, et al.
Published: (2026)

Meta-Learning Transformers to Improve In-Context Generalization
by: Braccaioli, Lorenzo, et al.
Published: (2025)

The Expressivity Boundary of Probabilistic Circuits: A Comparison with Large Language Models
by: Zhao, Zhiyu, et al.
Published: (2026)

GEAR: A General Evaluation Framework for Abductive Reasoning
by: He, Kaiyu, et al.
Published: (2025)

HiPRAG: Hierarchical Process Rewards for Efficient Agentic Retrieval Augmented Generation
by: Wu, Peilin, et al.
Published: (2025)

Hiformer: Hybrid Frequency Feature Enhancement Inverted Transformer for Long-Term Wind Power Prediction
by: Wan, Chongyang, et al.
Published: (2024)

Self-Predictive Representations for Combinatorial Generalization in Behavioral Cloning
by: Lawson, Daniel, et al.
Published: (2025)

Improving Large Language Model Safety with Contrastive Representation Learning
by: Simko, Samuel, et al.
Published: (2025)

Sharper Generalization Bounds for Transformer
by: Li, Yawen, et al.
Published: (2026)

A Behavior-Based Knowledge Representation Improves Prediction of Players' Moves in Chess by 25%
by: Skidanov, Benny, et al.
Published: (2025)

Improving Reasoning Performance in Large Language Models via Representation Engineering
by: Højer, Bertram, et al.
Published: (2025)

Do Retrieval-Augmented Language Models Adapt to Varying User Needs?
by: Wu, Peilin, et al.
Published: (2025)

Comparing Prior and Learned Time Representations in Transformer Models of Timeseries
by: Koliou, Natalia, et al.
Published: (2024)

Towards a Better Model with Dual Transformer for Drug Response Prediction
by: Li, Kun, et al.
Published: (2022)

Global-Lens Transformers: Adaptive Token Mixing for Dynamic Link Prediction
by: Zou, Tao, et al.
Published: (2025)

Towards the Reusability and Compositionality of Causal Representations
by: Talon, Davide, et al.
Published: (2024)

Improving Transformer World Models for Data-Efficient RL
by: Dedieu, Antoine, et al.
Published: (2025)

Bidirectional Generative Pre-training for Improving Healthcare Time-series Representation Learning
by: Song, Ziyang, et al.
Published: (2024)

Measuring Orthogonality in Representations of Generative Models
by: Geyer, Robin C., et al.
Published: (2024)

Intelligent Materials Modelling: Large Language Models Versus Partial Least Squares Regression for Predicting Polysulfone Membrane Mechanical Performance
by: Cao, Dingding, et al.
Published: (2026)

Transformers from Compressed Representations
by: Alcazar, Juan C. Leon, et al.
Published: (2025)

Representations Shape Weak-to-Strong Generalization: Theoretical Insights and Empirical Predictions
by: Xue, Yihao, et al.
Published: (2025)

Self-Improving Transformers Overcome Easy-to-Hard and Length Generalization Challenges
by: Lee, Nayoung, et al.
Published: (2025)

Improving Cardiac Risk Prediction Using Data Generation Techniques
by: Cabodevila, Alexandre, et al.
Published: (2025)

Can Large Language Models Understand Intermediate Representations in Compilers?
by: Jiang, Hailong, et al.
Published: (2025)

World Modelling Improves Language Model Agents
by: Guo, Shangmin, et al.
Published: (2025)

Representation Learning of Auxiliary Concepts for Improved Student Modeling and Exercise Recommendation
by: Badran, Yahya, et al.
Published: (2025)

Modeling Matches as Language: A Generative Transformer Approach for Counterfactual Player Valuation in Football
by: Hong, Miru, et al.
Published: (2026)

Graph Generative Pre-trained Transformer
by: Chen, Xiaohui, et al.
Published: (2025)

Improving Generalization of Neural Vehicle Routing Problem Solvers Through the Lens of Model Architecture
by: Xiao, Yubin, et al.
Published: (2024)

Exploring Task Unification in Graph Representation Learning via Generative Approach
by: Hu, Yulan, et al.
Published: (2024)