Salvato in:
Dettagli Bibliografici
Autori principali: Li, Ruikun, Yao, Jun, Hua, Yingfan, Tang, Shixiang, Qi, Biqing, Liu, Bin, Ouyang, Wanli, Lu, Yan
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:https://arxiv.org/abs/2602.19516
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915811992535040
author Li, Ruikun
Yao, Jun
Hua, Yingfan
Tang, Shixiang
Qi, Biqing
Liu, Bin
Ouyang, Wanli
Lu, Yan
author_facet Li, Ruikun
Yao, Jun
Hua, Yingfan
Tang, Shixiang
Qi, Biqing
Liu, Bin
Ouyang, Wanli
Lu, Yan
contents Discovering physical laws directly from high-dimensional visual data is a long-standing human pursuit but remains a formidable challenge for machines, representing a fundamental goal of scientific intelligence. This task is inherently difficult because physical knowledge is low-dimensional and structured, whereas raw video observations are high-dimensional and redundant, with most pixels carrying little or no physical meaning. Extracting concise, physically relevant variables from such noisy data remains a key obstacle. To address this, we propose Pixel2Phys, a collaborative multi-agent framework adaptable to any Multimodal Large Language Model (MLLM). It emulates human scientific reasoning by employing a structured workflow to extract formalized physical knowledge through iterative hypothesis generation, validation, and refinement. By repeatedly formulating, and refining candidate equations on high-dimensional data, it identifies the most concise representations that best capture the underlying physical evolution. This automated exploration mimics the iterative workflow of human scientists, enabling AI to reveal interpretable governing equations directly from raw observations. Across diverse simulated and real-world physics videos, Pixel2Phys discovers accurate, interpretable governing equations and maintaining stable long-term extrapolation where baselines rapidly diverge.
format Preprint
id arxiv_https___arxiv_org_abs_2602_19516
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Pixel2Phys: Distilling Governing Laws from Visual Dynamics
Li, Ruikun
Yao, Jun
Hua, Yingfan
Tang, Shixiang
Qi, Biqing
Liu, Bin
Ouyang, Wanli
Lu, Yan
Computational Engineering, Finance, and Science
Discovering physical laws directly from high-dimensional visual data is a long-standing human pursuit but remains a formidable challenge for machines, representing a fundamental goal of scientific intelligence. This task is inherently difficult because physical knowledge is low-dimensional and structured, whereas raw video observations are high-dimensional and redundant, with most pixels carrying little or no physical meaning. Extracting concise, physically relevant variables from such noisy data remains a key obstacle. To address this, we propose Pixel2Phys, a collaborative multi-agent framework adaptable to any Multimodal Large Language Model (MLLM). It emulates human scientific reasoning by employing a structured workflow to extract formalized physical knowledge through iterative hypothesis generation, validation, and refinement. By repeatedly formulating, and refining candidate equations on high-dimensional data, it identifies the most concise representations that best capture the underlying physical evolution. This automated exploration mimics the iterative workflow of human scientists, enabling AI to reveal interpretable governing equations directly from raw observations. Across diverse simulated and real-world physics videos, Pixel2Phys discovers accurate, interpretable governing equations and maintaining stable long-term extrapolation where baselines rapidly diverge.
title Pixel2Phys: Distilling Governing Laws from Visual Dynamics
topic Computational Engineering, Finance, and Science
url https://arxiv.org/abs/2602.19516