Imagen de Portada

Recognizing Everything from All Modalities at Once: Grounded Multimodal Universal Information Extraction

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Zhang, Meishan, Fei, Hao, Wang, Bin, Wu, Shengqiong, Cao, Yixin, Li, Fei, Zhang, Min
Formato:	Preprint
Publicado:	2024
Materias:	Multimedia
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

SpeechEE: A Novel Benchmark for Speech Event Extraction
por: Wang, Bin, et al.
Publicado: (2024)

MolCA: Molecular Graph-Language Modeling with Cross-Modal Projector and Uni-Modal Adapter
por: Liu, Zhiyuan, et al.
Publicado: (2023)

EmpathyEar: An Open-source Avatar Multimodal Empathetic Chatbot
por: Fei, Hao, et al.
Publicado: (2024)

CLEAR: Null-Space Projection for Cross-Modal De-Redundancy in Multimodal Recommendation
por: Zhan, Hao, et al.
Publicado: (2026)

OTCR: Optimal Transmission, Compression and Representation for Multimodal Information Extraction
por: Li, Yang, et al.
Publicado: (2025)

Hierarchical Refinement of Universal Multimodal Attacks on Vision-Language Models
por: Zhang, Peng-Fei, et al.
Publicado: (2026)

Multimodal Graph-Based Variational Mixture of Experts Network for Zero-Shot Multimodal Information Extraction
por: Zhou, Baohang, et al.
Publicado: (2025)

Hyperbolic Multimodal Generative Representation Learning for Generalized Zero-Shot Multimodal Information Extraction
por: Zhou, Baohang, et al.
Publicado: (2026)

ASAP: Advancing Semantic Alignment Promotes Multi-Modal Manipulation Detecting and Grounding
por: Zhang, Zhenxing, et al.
Publicado: (2024)

Chain-of-Modality: Learning Manipulation Programs from Multimodal Human Videos with Vision-Language-Models
por: Wang, Chen, et al.
Publicado: (2025)

Augmenting Intra-Modal Understanding in MLLMs for Robust Multimodal Keyphrase Generation
por: Cao, Jiajun, et al.
Publicado: (2025)

Enhancing Multimodal Entity and Relation Extraction with Variational Information Bottleneck
por: Cui, Shiyao, et al.
Publicado: (2023)

ISMAF: Intrinsic-Social Modality Alignment and Fusion for Multimodal Rumor Detection
por: Yu, Zihao, et al.
Publicado: (2025)

Beyond Forced Modality Balance: Intrinsic Information Budgets for Multimodal Learning
por: Xiong, Zechang, et al.
Publicado: (2026)

Token-Level Contrastive Learning with Modality-Aware Prompting for Multimodal Intent Recognition
por: Zhou, Qianrui, et al.
Publicado: (2023)

CueNet: Robust Audio-Visual Speaker Extraction through Cross-Modal Cue Mining and Interaction
por: Wang, Jiadong, et al.
Publicado: (2026)

Modality Curation: Building Universal Embeddings for Advanced Multimodal Information Retrieval
por: Kong, Fanheng, et al.
Publicado: (2025)

Towards Multimodal Empathetic Response Generation: A Rich Text-Speech-Vision Avatar-based Benchmark
por: Zhang, Han, et al.
Publicado: (2025)

Grounding is All You Need? Dual Temporal Grounding for Video Dialog
por: Qin, You, et al.
Publicado: (2024)

Mixture of Disentangled Experts with Missing Modalities for Robust Multimodal Sentiment Analysis
por: Li, Xiang, et al.
Publicado: (2026)

Muse: A Multimodal Conversational Recommendation Dataset with Scenario-Grounded User Profiles
por: Wang, Zihan, et al.
Publicado: (2024)

Towards Unified Representation of Multi-Modal Pre-training for 3D Understanding via Differentiable Rendering
por: Fei, Ben, et al.
Publicado: (2024)

Dark Side of Modalities: Reinforced Multimodal Distillation for Multimodal Knowledge Graph Reasoning
por: Zhao, Yu, et al.
Publicado: (2025)

TF-Mamba: Text-enhanced Fusion Mamba with Missing Modalities for Robust Multimodal Sentiment Analysis
por: Li, Xiang, et al.
Publicado: (2025)

TMDC: A Two-Stage Modality Denoising and Complementation Framework for Multimodal Sentiment Analysis with Missing and Noisy Modalities
por: Zhuang, Yan, et al.
Publicado: (2025)

Enhancing Multimodal Retrieval via Complementary Information Extraction and Alignment
por: Zeng, Delong, et al.
Publicado: (2026)

JavisDiT++: Unified Modeling and Optimization for Joint Audio-Video Generation
por: Liu, Kai, et al.
Publicado: (2026)

Unsupervised Multimodal Clustering for Semantics Discovery in Multimodal Utterances
por: Zhang, Hanlei, et al.
Publicado: (2024)

Divide and Conquer: Multimodal Video Deepfake Detection via Cross-Modal Fusion and Localization
por: Li, Qingcao, et al.
Publicado: (2026)

Rethinking Fusion: Disentangled Learning of Shared and Modality-Specific Information for Stance Detection
por: Xie, Zhiyu, et al.
Publicado: (2026)

Modality-Aware Identity Construction and Counterfactual Structure Learning for ID-Free Multimodal Recommendation
por: Ma, Hongjian, et al.
Publicado: (2026)

A Survey on Music Generation from Single-Modal, Cross-Modal, and Multi-Modal Perspectives
por: Li, Shuyu, et al.
Publicado: (2025)

MIND Your Reasoning: A Meta-Cognitive Intuitive-Reflective Network for Dual-Reasoning in Multimodal Stance Detection
por: Wang, Bingbing, et al.
Publicado: (2025)

Multimodal Emotion Recognition with Large Language Models
por: Zhang, Hongrui, et al.
Publicado: (2026)

Shapley Value-based Contrastive Alignment for Multimodal Information Extraction
por: Luo, Wen, et al.
Publicado: (2024)

MInD: Improving Multimodal Sentiment Analysis via Multimodal Information Disentanglement
por: Dai, Weichen, et al.
Publicado: (2024)

TeMTG: Text-Enhanced Multi-Hop Temporal Graph Modeling for Audio-Visual Video Parsing
por: Chen, Yaru, et al.
Publicado: (2025)

COPA: Efficient Vision-Language Pre-training Through Collaborative Object- and Patch-Text Alignment
por: Jiang, Chaoya, et al.
Publicado: (2023)

SIDQL: An Efficient Keyframe Extraction and Motion Reconstruction Framework in Motion Capture
por: Zhang, Xuling, et al.
Publicado: (2024)

MM-InstructEval: Zero-Shot Evaluation of (Multimodal) Large Language Models on Multimodal Reasoning Tasks
por: Yang, Xiaocui, et al.
Publicado: (2024)