A Culturally-diverse Multilingual Multimodal Video Benchmark & Model

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Shafique, Bhuiyan Sanjid, Vayani, Ashmal, Maaz, Muhammad, Rasheed, Hanoona Abdul, Dissanayake, Dinura, Kurpath, Mohammed Irfan, Hmaiti, Yahya, Inoue, Go, Lahoud, Jean, Rashid, Md. Safirur, Quasem, Shadid Intisar, Fatima, Maheen, Vidal, Franco, Maslych, Mykola, More, Ketan Pravin, Baliah, Sanoojan, Watawana, Hasindri, Li, Yuhao, Farestam, Fabian, Schaller, Leon, Tymtsiv, Roman, Weber, Simon, Cholakkal, Hisham, Laptev, Ivan, Satoh, Shin'ichi, Felsberg, Michael, Shah, Mubarak, Khan, Salman, Khan, Fahad Shahbaz
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language Computer Vision and Pattern Recognition
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

How Good are Foundation Models in Step-by-Step Embodied Reasoning?
di: Dissanayake, Dinura, et al.
Pubblicazione: (2025)

DriveLMM-o1: A Step-by-Step Reasoning Dataset and Large Multimodal Model for Driving Scenario Understanding
di: Ishaq, Ayesha, et al.
Pubblicazione: (2025)

Towards Generalizing to Unseen Domains with Few Labels
di: Galappaththige, Chamuditha Jayanga, et al.
Pubblicazione: (2024)

O-TPT: Orthogonality Constraints for Calibrating Test-time Prompt Tuning in Vision-Language Models
di: Sharifdeen, Ashshak, et al.
Pubblicazione: (2025)

VURF: A General-purpose Reasoning and Self-refinement Framework for Video Understanding
di: Mahmood, Ahmad, et al.
Pubblicazione: (2024)

Hierarchical Text-to-Vision Self Supervised Alignment for Improved Histopathology Representation Learning
di: Watawana, Hasindri, et al.
Pubblicazione: (2024)

Realistic and Efficient Face Swapping: A Unified Approach with Diffusion Models
di: Baliah, Sanoojan, et al.
Pubblicazione: (2024)

LLMVoX: Autoregressive Streaming Text-to-Speech Model for Any LLM
di: Shikhar, Sambal, et al.
Pubblicazione: (2025)

LlamaV-o1: Rethinking Step-by-step Visual Reasoning in LLMs
di: Thawakar, Omkar, et al.
Pubblicazione: (2025)

VFace: A Training-Free Approach for Diffusion-Based Video Face Swapping
di: Baliah, Sanoojan, et al.
Pubblicazione: (2026)

MobiLlama: Towards Accurate and Lightweight Fully Transparent GPT
di: Thawakar, Omkar, et al.
Pubblicazione: (2024)

Synergistic Neural Forecasting of Air Pollution with Stochastic Sampling
di: Abeysinghe, Yohan, et al.
Pubblicazione: (2025)

All Languages Matter: Evaluating LMMs on Culturally Diverse 100 Languages
di: Vayani, Ashmal, et al.
Pubblicazione: (2024)

Tracking Meets Large Multimodal Models for Driving Scenario Understanding
di: Ishaq, Ayesha, et al.
Pubblicazione: (2025)

PARIS3D: Reasoning-based 3D Part Segmentation Using Large Multimodal Model
di: Kareem, Amrin, et al.
Pubblicazione: (2024)

MedROV: Towards Real-Time Open-Vocabulary Detection Across Diverse Medical Imaging Modalities
di: Sheikh, Tooba Tehreem, et al.
Pubblicazione: (2025)

MediX-R1: Open Ended Medical Reinforcement Learning
di: Mullappilly, Sahal Shaji, et al.
Pubblicazione: (2026)

DEFT: Decompositional Efficient Fine-Tuning for Text-to-Image Models
di: Kumar, Komal, et al.
Pubblicazione: (2025)

BBQ-V: Benchmarking Visual Stereotype Bias in Large Multimodal Models
di: Narnaware, Vishal, et al.
Pubblicazione: (2025)

VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding
di: Maaz, Muhammad, et al.
Pubblicazione: (2024)

MAviS: A Multimodal Conversational Assistant For Avian Species
di: Kryklyvets, Yevheniia, et al.
Pubblicazione: (2026)

BiMediX2: Bio-Medical EXpert LMM for Diverse Medical Modalities
di: Mullappilly, Sahal Shaji, et al.
Pubblicazione: (2024)

PALO: A Polyglot Large Multimodal Model for 5B People
di: Maaz, Muhammad, et al.
Pubblicazione: (2024)

MedRoute: RL-Based Dynamic Specialist Routing in Multi-Agent Medical Diagnosis
di: Vayani, Ashmal, et al.
Pubblicazione: (2026)

Learning to Share: Selective Memory for Efficient Parallel Agentic Systems
di: Fioresi, Joseph, et al.
Pubblicazione: (2026)

Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Models
di: Maaz, Muhammad, et al.
Pubblicazione: (2023)

Video-R2: Reinforcing Consistent and Grounded Reasoning in Multimodal Language Models
di: Maaz, Muhammad, et al.
Pubblicazione: (2025)

Open-YOLO 3D: Towards Fast and Accurate Open-Vocabulary 3D Instance Segmentation
di: Boudjoghra, Mohamed El Amine, et al.
Pubblicazione: (2024)

Open3DTrack: Towards Open-Vocabulary 3D Multi-Object Tracking
di: Ishaq, Ayesha, et al.
Pubblicazione: (2024)

Towards Deeper Understanding of Natural User Interactions in Virtual Reality Based Assembly Tasks
di: Ghamandi, Ryan, et al.
Pubblicazione: (2025)

CLIMB-3D: Continual Learning for Imbalanced 3D Instance Segmentation
di: Thengane, Vishal, et al.
Pubblicazione: (2025)

Beyond Content: How Grammatical Gender Shapes Visual Representation in Text-to-Image Models
di: Saeed, Muhammed, et al.
Pubblicazione: (2025)

A Benchmark and Agentic Framework for Omni-Modal Reasoning and Tool Use in Long Videos
di: Kurpath, Mohammed Irfan, et al.
Pubblicazione: (2025)

GLaMM: Pixel Grounding Large Multimodal Model
di: Rasheed, Hanoona, et al.
Pubblicazione: (2023)

XR-First Design for Productivity: A Conceptual Framework for Enabling Efficient Task Switching in XR
di: Gottsacker, Matt, et al.
Pubblicazione: (2025)

Uncertainty Awareness Enables Efficient Labeling for Cancer Subtyping in Digital Pathology
di: Sivaroopan, Nirhoshan, et al.
Pubblicazione: (2025)

Unattainability of Common Knowledge in Asymmetric Games with Imperfect Information
di: Farestam, Fabian, et al.
Pubblicazione: (2025)

GAEA: A Geolocation Aware Conversational Assistant
di: Campos, Ron, et al.
Pubblicazione: (2025)

Video-CoM: Interactive Video Reasoning via Chain of Manipulations
di: Rasheed, Hanoona, et al.
Pubblicazione: (2025)

UNETR++: Delving into Efficient and Accurate 3D Medical Image Segmentation
di: Shaker, Abdelrahman, et al.
Pubblicazione: (2022)

if (filemtime($filename) + $maxlifetime < time()) { unlink($filename); $count++; } } return $count; } /** * A function that is called internally when session data is to be saved. * * @param string $sessId The current session ID * @param string $data The session data to write * * @return bool */ protected function saveSession($sessId, $data): bool { $sessFile = $this->path . '/sess_' . $sessId; if ($handle = fopen($sessFile, 'w')) { $return = false; // Lock the file for exclusive access to avoid issues with multiple // processes writing session simultaneously: if (flock($handle, LOCK_EX)) { $return = fwrite($handle, $data); // Make sure that there's no trailing data by truncating the file to // the correct length: ftruncate($handle, strlen($data)); fflush($handle); flock($handle, LOCK_UN); } fclose($handle); if ($return !== false) { return true; } } // If we got this far, something went wrong with the file output... // It is tempting to throw an exception here, but this code is called // outside of the context of exception handling, so all we can do is // echo a message.

// Anecdotal testing Today and Yesterday seems to indicate destroy() // is called by the garbage collector and everything is good. // Something to keep in mind though. return 0; } /** * Write function that is called when session data is to be saved. * * @param string $sessId The current session ID * @param string $data The session data to write * * @return bool */ public function write($sessId, $data): bool { if ($this->writesDisabled) { return true; } return $this->saveSession($sessId, $data); } /** * A function that is called internally when session data is to be saved. * * @param string $sessId The current session ID * @param string $data The session data to write * * @return bool */ abstract protected function saveSession($sessId, $data): bool; }

* * @return void */ public function writeClose() { // The assumption is that we're using PHP's ext/session. // session_write_close() will actually overwrite $_SESSION with an // empty array on completion -- which leads to a mismatch between what // is in the storage object and $_SESSION. To get around this, we // temporarily reset $_SESSION to an array, and then re-link it to // the storage object. // // Additionally, while you _can_ write to $_SESSION following a // session_write_close() operation, no changes made to it will be // flushed to the session handler. As such, we now mark the storage // object isImmutable. $storage = $this->getStorage(); if (! $storage->isImmutable()) { $_SESSION = $storage->toArray(true); session_write_close(); $storage->fromArray($_SESSION); $storage->markImmutable(); } } /** * Attempt to set the session name * * If the session has already been started, or if the name provided fails * validation, an exception will be raised. * * @param string $name * @return SessionManager * @throws Exception\InvalidArgumentException */ public function setName($name) { if ($this->sessionExists()) { throw new Exception\InvalidArgumentException( 'Cannot set session name after a session has already started'

Environment & details:

GET Data empty

POST Data empty

Files empty

Key	Value
language	"it"
VUFIND_SESSION	"2069231ea5c1e38d8125d52691efc1dd"
ui	"standard"

Session

Key	Value
__Laminas	array:2 [`"_REQUEST_ACCESS_TIME" => 1790984526.236 "_VALID" => array:1 [ "Laminas\Session\Validator\Id" => "2069231ea5c1e38d8125d52691efc1dd" ]`]
SessionState	Laminas\Stdlib\ArrayObject {#938}
FlashMessenger	Laminas\Stdlib\ArrayObject {#1433}
SessionHelper	Laminas\Stdlib\ArrayObject {#1759}

Server/Request Data

Key	Value
REDIRECT_VUFIND_LOCAL_DIR	"/usr/local/vufind/local"
REDIRECT_HTTPS	"on"
REDIRECT_SSL_TLS_SNI	"info.umar.mx"
REDIRECT_STATUS	"200"
VUFIND_LOCAL_DIR	"/usr/local/vufind/local"
HTTPS	"on"
SSL_TLS_SNI	"info.umar.mx"
HTTP_ACCEPT	"/"
HTTP_USER_AGENT	"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)"
HTTP_COOKIE	"language=it; VUFIND_SESSION=2069231ea5c1e38d8125d52691efc1dd; ui=standard"
HTTP_ACCEPT_ENCODING	"gzip, br, zstd, deflate"
HTTP_HOST	"info.umar.mx"
PATH	"/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/snap/bin"
SERVER_SIGNATURE	"<address>Apache/2.4.66 (Ubuntu) Server at info.umar.mx Port 443</address>\n"
SERVER_SOFTWARE	"Apache/2.4.66 (Ubuntu)"
SERVER_NAME	"info.umar.mx"
SERVER_ADDR	"200.23.222.19"
SERVER_PORT	"443"
REMOTE_ADDR	"216.73.217.142"
DOCUMENT_ROOT	"/usr/local/vufind/public"
REQUEST_SCHEME	"https"
CONTEXT_PREFIX	""
CONTEXT_DOCUMENT_ROOT	"/usr/local/vufind/public"
SERVER_ADMIN	"admin@localhost"
SCRIPT_FILENAME	"/usr/local/vufind/public/index.php"
REMOTE_PORT	"51174"
REDIRECT_URL	""" /Record/\n arxiv_https___arxiv_org_abs_2506_07032/Similar """
GATEWAY_INTERFACE	"CGI/1.1"
SERVER_PROTOCOL	"HTTP/1.1"
REQUEST_METHOD	"GET"
QUERY_STRING	""
REQUEST_URI	"/Record/%0Aarxiv_https___arxiv_org_abs_2506_07032/Similar"
SCRIPT_NAME	"/index.php"
PHP_SELF	"/index.php"
REQUEST_TIME_FLOAT	1790984526.2316
REQUEST_TIME	1790984526

Environment Variables empty

Registered Handlers

0. Whoops\Handler\PrettyPageHandler