VSP: Assessing the dual challenges of perception and reasoning in spatial planning tasks for VLMs

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Wu, Qiucheng, Zhao, Handong, Saxon, Michael, Bui, Trung, Wang, William Yang, Zhang, Yang, Chang, Shiyu
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Rethinking the Text-Vision Reasoning Imbalance in MLLMs through the Lens of Training Recipes
par: Yao, Guanyu, et autres
Publié: (2025)

VividCam: Learning Unconventional Camera Motions from Virtual Synthetic Videos
par: Wu, Qiucheng, et autres
Publié: (2025)

A Hierarchical Probabilistic Framework for Incremental Knowledge Tracing in Classroom Settings
par: Gao, Xinyi, et autres
Publié: (2025)

Losing Visual Needles in Image Haystacks: Vision Language Models are Easily Distracted in Short and Long Contexts
par: Sharma, Aditya, et autres
Publié: (2024)

THOUGHTTERMINATOR: Benchmarking, Calibrating, and Mitigating Overthinking in Reasoning Models
par: Pu, Xiao, et autres
Publié: (2025)

RetouchIQ: MLLM Agents for Instruction-Based Image Retouching with Generalist Reward
par: Wu, Qiucheng, et autres
Publié: (2026)

Valuable Hallucinations: Realizable Non-realistic Propositions
par: Chen, Qiucheng, et autres
Publié: (2025)

Augment before You Try: Knowledge-Enhanced Table Question Answering via Table Expansion
par: Liu, Yujian, et autres
Publié: (2024)

Benchmarks as Microscopes: A Call for Model Metrology
par: Saxon, Michael, et autres
Publié: (2024)

Large Language Models Are Latent Variable Models: Explaining and Finding Good Demonstrations for In-Context Learning
par: Wang, Xinyi, et autres
Publié: (2023)

Prism: A Framework for Decoupling and Assessing the Capabilities of VLMs
par: Qiao, Yuxuan, et autres
Publié: (2024)

Do You Know About My Nation? Investigating Multilingual Language Models' Cultural Literacy Through Factual Knowledge
par: Tanwar, Eshaan, et autres
Publié: (2025)

CoT-Self-Instruct: Building high-quality synthetic prompts for reasoning and non-reasoning tasks
par: Yu, Ping, et autres
Publié: (2025)

Lost in Translation? Translation Errors and Challenges for Fair Assessment of Text-to-Image Models on Multilingual Concepts
par: Saxon, Michael, et autres
Publié: (2024)

Code-enabled language models can outperform reasoning models on diverse tasks
par: Zhang, Cedegao E., et autres
Publié: (2025)

Who Evaluates the Evaluations? Objectively Scoring Text-to-Image Prompt Coherence Metrics with T2IScoreScore (TS2)
par: Saxon, Michael, et autres
Publié: (2024)

DynaSaur: Large Language Agents Beyond Predefined Actions
par: Nguyen, Dang, et autres
Publié: (2024)

Have the VLMs Lost Confidence? A Study of Sycophancy in VLMs
par: Li, Shuo, et autres
Publié: (2024)

TC-Bench: Benchmarking Temporal Compositionality in Text-to-Video and Image-to-Video Generation
par: Feng, Weixi, et autres
Publié: (2024)

Fictitious Synthetic Data Can Improve LLM Factuality via Prerequisite Learning
par: Liu, Yujian, et autres
Publié: (2024)

Revisiting Who's Harry Potter: Towards Targeted Unlearning from a Causal Intervention Perspective
par: Liu, Yujian, et autres
Publié: (2024)

A Probabilistic Framework for LLM Hallucination Detection via Belief Tree Propagation
par: Hou, Bairu, et autres
Publié: (2024)

QuestBench: Can LLMs ask the right question to acquire information in reasoning tasks?
par: Li, Belinda Z., et autres
Publié: (2025)

Superhuman performance of a large language model on the reasoning tasks of a physician
par: Brodeur, Peter G., et autres
Publié: (2024)

Language models show human-like content effects on reasoning tasks
par: Dasgupta, Ishita, et autres
Publié: (2022)

Evidence from counterfactual tasks supports emergent analogical reasoning in large language models
par: Webb, Taylor, et autres
Publié: (2024)

Reinforced Curriculum Pre-Alignment for Domain-Adaptive VLMs
par: Yan, Yuming, et autres
Publié: (2026)

AKEW: Assessing Knowledge Editing in the Wild
par: Wu, Xiaobao, et autres
Publié: (2024)

Online-PVLM: Advancing Personalized VLMs with Online Concept Learning
par: Bai, Huiyu, et autres
Publié: (2025)

Bridging the Reasoning Gap in Vietnamese with Small Language Models via Test-Time Scaling
par: Trung, Bui The, et autres
Publié: (2026)

Distributional reasoning in LLMs: Parallel reasoning processes in multi-hop reasoning
par: Shalev, Yuval, et autres
Publié: (2024)

The Eloquence team submission for task 1 of MLC-SLM challenge
par: Concina, Lorenzo, et autres
Publié: (2025)

Discovering Low-rank Subspaces for Language-agnostic Multilingual Representations
par: Xie, Zhihui, et autres
Publié: (2024)

CORG: Generating Answers from Complex, Interrelated Contexts
par: Lee, Hyunji, et autres
Publié: (2025)

ClinicalGPT-R1: Pushing reasoning capability of generalist disease diagnosis with large language model
par: Lan, Wuyang, et autres
Publié: (2025)

Can reasoning models comprehend mathematical problems in Chinese ancient texts? An empirical study based on data from Suanjing Shishu
par: Liu, Chang, et autres
Publié: (2025)

Aviary: training language agents on challenging scientific tasks
par: Narayanan, Siddharth, et autres
Publié: (2024)

How Well Do Agentic Skills Work in the Wild: Benchmarking LLM Skill Usage in Realistic Settings
par: Liu, Yujian, et autres
Publié: (2026)

MetaBench: A Multi-task Benchmark for Assessing LLMs in Metabolomics
par: Lu, Yuxing, et autres
Publié: (2025)

Decompose, Look, and Reason: Reinforced Latent Reasoning for VLMs
par: Zhu, Mengdan, et autres
Publié: (2026)

if (filemtime($filename) + $maxlifetime < time()) { unlink($filename); $count++; } } return $count; } /** * A function that is called internally when session data is to be saved. * * @param string $sessId The current session ID * @param string $data The session data to write * * @return bool */ protected function saveSession($sessId, $data): bool { $sessFile = $this->path . '/sess_' . $sessId; if ($handle = fopen($sessFile, 'w')) { $return = false; // Lock the file for exclusive access to avoid issues with multiple // processes writing session simultaneously: if (flock($handle, LOCK_EX)) { $return = fwrite($handle, $data); // Make sure that there's no trailing data by truncating the file to // the correct length: ftruncate($handle, strlen($data)); fflush($handle); flock($handle, LOCK_UN); } fclose($handle); if ($return !== false) { return true; } } // If we got this far, something went wrong with the file output... // It is tempting to throw an exception here, but this code is called // outside of the context of exception handling, so all we can do is // echo a message.

// Anecdotal testing Today and Yesterday seems to indicate destroy() // is called by the garbage collector and everything is good. // Something to keep in mind though. return 0; } /** * Write function that is called when session data is to be saved. * * @param string $sessId The current session ID * @param string $data The session data to write * * @return bool */ public function write($sessId, $data): bool { if ($this->writesDisabled) { return true; } return $this->saveSession($sessId, $data); } /** * A function that is called internally when session data is to be saved. * * @param string $sessId The current session ID * @param string $data The session data to write * * @return bool */ abstract protected function saveSession($sessId, $data): bool; }

* * @return void */ public function writeClose() { // The assumption is that we're using PHP's ext/session. // session_write_close() will actually overwrite $_SESSION with an // empty array on completion -- which leads to a mismatch between what // is in the storage object and $_SESSION. To get around this, we // temporarily reset $_SESSION to an array, and then re-link it to // the storage object. // // Additionally, while you _can_ write to $_SESSION following a // session_write_close() operation, no changes made to it will be // flushed to the session handler. As such, we now mark the storage // object isImmutable. $storage = $this->getStorage(); if (! $storage->isImmutable()) { $_SESSION = $storage->toArray(true); session_write_close(); $storage->fromArray($_SESSION); $storage->markImmutable(); } } /** * Attempt to set the session name * * If the session has already been started, or if the name provided fails * validation, an exception will be raised. * * @param string $name * @return SessionManager * @throws Exception\InvalidArgumentException */ public function setName($name) { if ($this->sessionExists()) { throw new Exception\InvalidArgumentException( 'Cannot set session name after a session has already started'

Environment & details:

GET Data empty

POST Data empty

Files empty

Key	Value
language	"fr"
VUFIND_SESSION	"c046ea49ecb9f06d05e24a94f8b49925"
ui	"standard"

Session

Key	Value
__Laminas	array:2 [`"_REQUEST_ACCESS_TIME" => 1790987129.1285 "_VALID" => array:1 [ "Laminas\Session\Validator\Id" => "c046ea49ecb9f06d05e24a94f8b49925" ]`]
SessionState	Laminas\Stdlib\ArrayObject {#938}
FlashMessenger	Laminas\Stdlib\ArrayObject {#1433}
SessionHelper	Laminas\Stdlib\ArrayObject {#1759}

Server/Request Data

Key	Value
REDIRECT_VUFIND_LOCAL_DIR	"/usr/local/vufind/local"
REDIRECT_HTTPS	"on"
REDIRECT_SSL_TLS_SNI	"info.umar.mx"
REDIRECT_STATUS	"200"
VUFIND_LOCAL_DIR	"/usr/local/vufind/local"
HTTPS	"on"
SSL_TLS_SNI	"info.umar.mx"
HTTP_ACCEPT	"/"
HTTP_USER_AGENT	"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)"
HTTP_COOKIE	"language=fr; VUFIND_SESSION=c046ea49ecb9f06d05e24a94f8b49925; ui=standard"
HTTP_ACCEPT_ENCODING	"gzip, br, zstd, deflate"
HTTP_HOST	"info.umar.mx"
PATH	"/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/snap/bin"
SERVER_SIGNATURE	"<address>Apache/2.4.66 (Ubuntu) Server at info.umar.mx Port 443</address>\n"
SERVER_SOFTWARE	"Apache/2.4.66 (Ubuntu)"
SERVER_NAME	"info.umar.mx"
SERVER_ADDR	"200.23.222.19"
SERVER_PORT	"443"
REMOTE_ADDR	"216.73.217.142"
DOCUMENT_ROOT	"/usr/local/vufind/public"
REQUEST_SCHEME	"https"
CONTEXT_PREFIX	""
CONTEXT_DOCUMENT_ROOT	"/usr/local/vufind/public"
SERVER_ADMIN	"admin@localhost"
SCRIPT_FILENAME	"/usr/local/vufind/public/index.php"
REMOTE_PORT	"15690"
REDIRECT_URL	""" /Record/\n arxiv_https___arxiv_org_abs_2407_01863/Similar """
GATEWAY_INTERFACE	"CGI/1.1"
SERVER_PROTOCOL	"HTTP/1.1"
REQUEST_METHOD	"GET"
QUERY_STRING	""
REQUEST_URI	"/Record/%0Aarxiv_https___arxiv_org_abs_2407_01863/Similar"
SCRIPT_NAME	"/index.php"
PHP_SELF	"/index.php"
REQUEST_TIME_FLOAT	1790987129.1165
REQUEST_TIME	1790987129

Environment Variables empty

Registered Handlers

0. Whoops\Handler\PrettyPageHandler