Cover Image

Transformers As Approximations of Solomonoff Induction

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Young, Nathan, Witbrock, Michael
Format:	Preprint
Published:	2024
Subjects:	Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Large Language Models as Computable Approximations to Solomonoff Induction
by: Wan, Jun, et al.
Published: (2025)

Solomonoff-Inspired Hypothesis Ranking with LLMs for Prediction Under Uncertainty
by: Barber, Josh, et al.
Published: (2025)

Separating Diagnosis from Control: Auditable Policy Adaptation in Agent-Based Simulations with LLM-Based Diagnostics
by: Zhong, Shaoxin, et al.
Published: (2026)

Using Large Language Models for the Interpretation of Building Regulations
by: Fuchs, Stefan, et al.
Published: (2024)

Conflict-Aware Fusion: Mitigating Logic Inertia in Large Language Models via Structured Cognitive Priors
by: Bao, Qiming, et al.
Published: (2025)

RLearner-LLM: Balancing Logical Grounding and Fluency in Large Language Models via Hybrid Direct Preference Optimization
by: Bao, Qiming, et al.
Published: (2026)

KCR: Resolving Long-Context Knowledge Conflicts via Reasoning in LLMs
by: Zheng, Xianda, et al.
Published: (2025)

A Survey of Pun Generation: Datasets, Evaluations and Methodologies
by: Su, Yuchen, et al.
Published: (2025)

Gaussian Match-and-Copy: A Minimalist Benchmark for Studying Transformer Induction
by: Gonon, Antoine, et al.
Published: (2026)

Abstract Meaning Representation-Based Logic-Driven Data Augmentation for Logical Reasoning
by: Bao, Qiming, et al.
Published: (2023)

BIRD: Behavior Induction via Representation-structure Distillation
by: Pogoncheff, Galen, et al.
Published: (2025)

Large Language Models as Common-Sense Heuristics
by: Borro, Andrey, et al.
Published: (2025)

Bridging the Reasoning Gap: Small LLMs Can Plan with Generalised Strategies
by: Borro, Andrey, et al.
Published: (2025)

Transformer Approximations from ReLUs
by: Hu, Jerry Yao-Chieh, et al.
Published: (2026)

What One Cannot, Two Can: Two-Layer Transformers Provably Represent Induction Heads on Any-Order Markov Chains
by: Ekbote, Chanakya, et al.
Published: (2025)

HealthSLM-Bench: Benchmarking Small Language Models for Mobile and Wearable Healthcare Monitoring
by: Wang, Xin, et al.
Published: (2025)

Assessing and Enhancing the Robustness of Large Language Models with Task Structure Variations for Logical Reasoning
by: Bao, Qiming, et al.
Published: (2023)

Generative AI Augmented Induction-based Formal Verification
by: Kumar, Aman, et al.
Published: (2024)

Optimising the attribute order in Fuzzy Rough Rule Induction
by: Bollaert, Henri, et al.
Published: (2025)

Solomonoff induction
by: Sterkenburg, Tom F.
Published: (2026)

Transformer Based Planning in the Observation Space with Applications to Trick Taking Card Games
by: Rebstock, Douglas, et al.
Published: (2024)

Concept Induction using LLMs: a user experiment for assessment
by: Barua, Adrita, et al.
Published: (2024)

LLM-Guided Probabilistic Program Induction for POMDP Model Estimation
by: Curtis, Aidan, et al.
Published: (2025)

CHAIRO: Contextual Hierarchical Analogical Induction and Reasoning Optimization for LLMs
by: Lu, Haotian, et al.
Published: (2026)

Unveiling Induction Heads: Provable Training Dynamics and Feature Learning in Transformers
by: Chen, Siyu, et al.
Published: (2024)

Universal Approximation Theorem for a Single-Layer Transformer
by: Gumaan, Esmail
Published: (2025)

2-Cats: 2D Copula Approximating Transforms
by: Figueiredo, Flavio, et al.
Published: (2023)

On the Emergence of Induction Heads for In-Context Learning
by: Musat, Tiberiu, et al.
Published: (2025)

Trust Region Reward Optimization and Proximal Inverse Reward Optimization Algorithm
by: Chen, Yang, et al.
Published: (2025)

INTRYGUE: Induction-Aware Entropy Gating for Reliable RAG Uncertainty Estimation
by: Bazarova, Alexandra, et al.
Published: (2026)

Monet: Mixture of Monosemantic Experts for Transformers
by: Park, Jungwoo, et al.
Published: (2024)

Program-Based Strategy Induction for Reinforcement Learning
by: Correa, Carlos G., et al.
Published: (2024)

Linguistic Structure Induction from Language Models
by: Momen, Omar
Published: (2024)

Grammar Induction from Visual, Speech and Text
by: Zhao, Yu, et al.
Published: (2024)

Musical Phrase Segmentation via Grammatical Induction
by: Perkins, Reed, et al.
Published: (2024)

Leveraging Grammar Induction for Language Understanding and Generation
by: Kai, Jushi, et al.
Published: (2024)

Symmetry and Generalisation in Neural Approximations of Renormalisation Transformations
by: Ashworth, Cassidy, et al.
Published: (2025)

GTAC: A Generative Transformer for Approximate Circuits
by: Wang, Jingxin, et al.
Published: (2025)

SGFormer: Single-Layer Graph Transformers with Approximation-Free Linear Complexity
by: Wu, Qitian, et al.
Published: (2024)

Implicit Statistical Inference in Transformers: Approximating Likelihood-Ratio Tests In-Context
by: Chaudhry, Faris, et al.
Published: (2026)