Cover Image

UMIE: Unified Multimodal Information Extraction with Instruction Tuning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Sun, Lin, Zhang, Kai, Li, Qingyuan, Lou, Renze
Format:	Preprint
Published:	2024
Subjects:	Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

MUFFIN: Curating Multi-Faceted Instructions for Improving Instruction-Following
by: Lou, Renze, et al.
Published: (2023)

Adaptive Chameleon or Stubborn Sloth: Revealing the Behavior of Large Language Models in Knowledge Conflicts
by: Xie, Jian, et al.
Published: (2023)

MAQInstruct: Instruction-based Unified Event Relation Extraction
by: Xu, Jun, et al.
Published: (2025)

Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning
by: Cheng, Zebang, et al.
Published: (2024)

MAny: Merge Anything for Multimodal Continual Instruction Tuning
by: Gao, Zijian, et al.
Published: (2026)

The Model Agreed, But Didn't Learn: Diagnosing Surface Compliance in Large Language Models
by: Gu, Xiaojie, et al.
Published: (2026)

Scaling Up Biomedical Vision-Language Models: Fine-Tuning, Instruction Tuning, and Multi-Modal Learning
by: Peng, Cheng, et al.
Published: (2025)

Chain-of-Scrutiny: Detecting Backdoor Attacks for Large Language Models
by: Li, Xi, et al.
Published: (2024)

YAYI-UIE: A Chat-Enhanced Instruction Tuning Framework for Universal Information Extraction
by: Xiao, Xinglin, et al.
Published: (2023)

Enhancing Multimodal Continual Instruction Tuning with BranchLoRA
by: Zhang, Duzhen, et al.
Published: (2025)

MIG: Automatic Data Selection for Instruction Tuning by Maximizing Information Gain in Semantic Space
by: Chen, Yicheng, et al.
Published: (2025)

MINT: Multimodal Instruction Tuning with Multimodal Interaction Grouping
by: Shan, Xiaojun, et al.
Published: (2025)

A Study of Large Language Models for Patient Information Extraction: Model Architecture, Fine-Tuning Strategy, and Multi-task Instruction Tuning
by: Peng, Cheng, et al.
Published: (2025)

Low-Resource Fine-Tuning for Multi-Task Structured Information Extraction with a Billion-Parameter Instruction-Tuned Model
by: Chih, Yu Cheng, et al.
Published: (2025)

The Effect of Sampling Temperature on Problem Solving in Large Language Models
by: Renze, Matthew, et al.
Published: (2024)

Self-Reflection in LLM Agents: Effects on Problem-Solving Performance
by: Renze, Matthew, et al.
Published: (2024)

The Benefits of a Concise Chain of Thought on Problem-Solving in Large Language Models
by: Renze, Matthew, et al.
Published: (2024)

Towards Automatic Continual Learning: A Self-Adaptive Framework for Continual Instruction Tuning
by: Lin, Peiyi, et al.
Published: (2025)

ScalSelect: Scalable Training-Free Multimodal Data Selection for Efficient Visual Instruction Tuning
by: Wu, Changti, et al.
Published: (2026)

Span-level Emotion-Cause-Category Triplet Extraction with Instruction Tuning LLMs and Data Augmentation
by: Li, Xiangju, et al.
Published: (2025)

Semantic Generative Tuning for Unified Multimodal Models
by: Yu, Songsong, et al.
Published: (2026)

Visual Instruction Bottleneck Tuning
by: Oh, Changdae, et al.
Published: (2025)

Collaborative Multi-LoRA Experts with Achievement-based Multi-Tasks Loss for Unified Multimodal Information Extraction
by: Yuan, Li, et al.
Published: (2025)

MCITlib: Multimodal Continual Instruction Tuning Library and Benchmark
by: Guo, Haiyang, et al.
Published: (2025)

ChatUIE: Exploring Chat-based Unified Information Extraction using Large Language Models
by: Xu, Jun, et al.
Published: (2024)

REMOTE: A Unified Multimodal Relation Extraction Framework with Multilevel Optimal Transport and Mixture-of-Experts
by: Lin, Xinkui, et al.
Published: (2025)

Towards Robust Instruction Tuning on Multimodal Large Language Models
by: Han, Wei, et al.
Published: (2024)

SAME: Stabilized Mixture-of-Experts for Multimodal Continual Instruction Tuning
by: Xie, Zhen-Hao, et al.
Published: (2026)

Federated Continual Instruction Tuning
by: Guo, Haiyang, et al.
Published: (2025)

PathInsight: Instruction Tuning of Multimodal Datasets and Models for Intelligence Assisted Diagnosis in Histopathology
by: Wu, Xiaomin, et al.
Published: (2024)

Enhancing Multimodal Retrieval via Complementary Information Extraction and Alignment
by: Zeng, Delong, et al.
Published: (2026)

Aligning Instruction Tuning with Pre-training
by: Liang, Yiming, et al.
Published: (2025)

Span-Oriented Information Extraction -- A Unifying Perspective on Information Extraction
by: Ding, Yifan, et al.
Published: (2024)

Large Language Model Instruction Following: A Survey of Progresses and Challenges
by: Lou, Renze, et al.
Published: (2023)

On Unified Prompt Tuning for Request Quality Assurance in Public Code Review
by: Chen, Xinyu, et al.
Published: (2024)

MMC: Advancing Multimodal Chart Understanding with Large-scale Instruction Tuning
by: Liu, Fuxiao, et al.
Published: (2023)

SEFE: Superficial and Essential Forgetting Eliminator for Multimodal Continual Instruction Tuning
by: Chen, Jinpeng, et al.
Published: (2025)

Balancing Truthfulness and Informativeness with Uncertainty-Aware Instruction Fine-Tuning
by: Wu, Tianyi, et al.
Published: (2025)

Bottleneck Tokens for Unified Multimodal Retrieval
by: Sun, Siyu, et al.
Published: (2026)

VisNec: Measuring and Leveraging Visual Necessity for Multimodal Instruction Tuning
by: Dong, Mingkang, et al.
Published: (2026)