Pre-Training Meta-Rule Selection Policy for Visual Generative Abductive Learning

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Jin, Yu, Liu, Jingming, Luo, Zhexu, Peng, Yifei, Qin, Ziang, Dai, Wang-Zhou, Ding, Yao-Xiang, Zhou, Kun
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929748884586496
author Jin, Yu
Liu, Jingming
Luo, Zhexu
Peng, Yifei
Qin, Ziang
Dai, Wang-Zhou
Ding, Yao-Xiang
Zhou, Kun
author_facet Jin, Yu
Liu, Jingming
Luo, Zhexu
Peng, Yifei
Qin, Ziang
Dai, Wang-Zhou
Ding, Yao-Xiang
Zhou, Kun
contents Visual generative abductive learning studies jointly training symbol-grounded neural visual generator and inducing logic rules from data, such that after learning, the visual generation process is guided by the induced logic rules. A major challenge for this task is to reduce the time cost of logic abduction during learning, an essential step when the logic symbol set is large and the logic rule to induce is complicated. To address this challenge, we propose a pre-training method for obtaining meta-rule selection policy for the recently proposed visual generative learning approach AbdGen [Peng et al., 2023], aiming at significantly reducing the candidate meta-rule set and pruning the search space. The selection model is built based on the embedding representation of both symbol grounding of cases and meta-rules, which can be effectively integrated with both neural model and logic reasoning system. The pre-training process is done on pure symbol data, not involving symbol grounding learning of raw visual inputs, making the entire learning process low-cost. An additional interesting observation is that the selection policy can rectify symbol grounding errors unseen during pre-training, which is resulted from the memorization ability of attention mechanism and the relative stability of symbolic patterns. Experimental results show that our method is able to effectively address the meta-rule selection problem for visual abduction, boosting the efficiency of visual generative abductive learning. Code is available at https://github.com/future-item/metarule-select.
format Preprint
id arxiv_https___arxiv_org_abs_2503_06427
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Pre-Training Meta-Rule Selection Policy for Visual Generative Abductive Learning
Jin, Yu
Liu, Jingming
Luo, Zhexu
Peng, Yifei
Qin, Ziang
Dai, Wang-Zhou
Ding, Yao-Xiang
Zhou, Kun
Machine Learning
Artificial Intelligence
Computer Vision and Pattern Recognition
Visual generative abductive learning studies jointly training symbol-grounded neural visual generator and inducing logic rules from data, such that after learning, the visual generation process is guided by the induced logic rules. A major challenge for this task is to reduce the time cost of logic abduction during learning, an essential step when the logic symbol set is large and the logic rule to induce is complicated. To address this challenge, we propose a pre-training method for obtaining meta-rule selection policy for the recently proposed visual generative learning approach AbdGen [Peng et al., 2023], aiming at significantly reducing the candidate meta-rule set and pruning the search space. The selection model is built based on the embedding representation of both symbol grounding of cases and meta-rules, which can be effectively integrated with both neural model and logic reasoning system. The pre-training process is done on pure symbol data, not involving symbol grounding learning of raw visual inputs, making the entire learning process low-cost. An additional interesting observation is that the selection policy can rectify symbol grounding errors unseen during pre-training, which is resulted from the memorization ability of attention mechanism and the relative stability of symbolic patterns. Experimental results show that our method is able to effectively address the meta-rule selection problem for visual abduction, boosting the efficiency of visual generative abductive learning. Code is available at https://github.com/future-item/metarule-select.
title Pre-Training Meta-Rule Selection Policy for Visual Generative Abductive Learning
topic Machine Learning
Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.06427