OmniBal: Towards Fast Instruction-Tuning for Vision-Language Models via Omniverse Computation Balance
Fuente:
arXiv
Saved in:
| Main Authors: | Yao, Yongqiang, Tan, Jingru, Zhang, Feizhao, Hu, Jiahao, Niu, Yazhe, Jin, Xin, Li, Bo, Liu, Pengfei, Gong, Ruihao, Lin, Dahua, Xu, Ningyi |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Hierarchical Balance Packing: Towards Efficient Supervised Fine-tuning for Long-Context LLM
by: Yao, Yongqiang, et al.
Published: (2025)
by: Yao, Yongqiang, et al.
Published: (2025)
OmniGen2: Towards Instruction-Aligned Multimodal Generation
by: Wu, Chenyuan, et al.
Published: (2025)
by: Wu, Chenyuan, et al.
Published: (2025)
HH-Codec: High Compression High-fidelity Discrete Neural Codec for Spoken Language Modeling
by: Xue, Rongkun, et al.
Published: (2025)
by: Xue, Rongkun, et al.
Published: (2025)
Let Androids Dream of Electric Sheep: A Human-Inspired Image Implication Understanding and Reasoning Framework
by: Zhang, Chenhao, et al.
Published: (2025)
by: Zhang, Chenhao, et al.
Published: (2025)
TreeTensor: Boost AI System on Nested Data with Constrained Tree-Like Tensor
by: Zhang, Shaoang, et al.
Published: (2026)
by: Zhang, Shaoang, et al.
Published: (2026)
BalLOT: Balanced $k$-means clustering with optimal transport
by: Luo, Wenyan, et al.
Published: (2025)
by: Luo, Wenyan, et al.
Published: (2025)
CoTZero: Annotation-Free Human-Like Vision Reasoning via Hierarchical Synthetic CoT
by: Du, Chengyi, et al.
Published: (2026)
by: Du, Chengyi, et al.
Published: (2026)
Listen, Pause, and Reason: Toward Perception-Grounded Hybrid Reasoning for Audio Understanding
by: Wang, Jieyi, et al.
Published: (2026)
by: Wang, Jieyi, et al.
Published: (2026)
Parameter Efficient Instruction Tuning: An Empirical Study
by: He, Pengfei
Published: (2024)
by: He, Pengfei
Published: (2024)
Seeing No Evil: Blinding Large Vision-Language Models to Safety Instructions via Adversarial Attention Hijacking
by: Li, Jingru, et al.
Published: (2026)
by: Li, Jingru, et al.
Published: (2026)
OmniVL-Guard: Towards Unified Vision-Language Forgery Detection and Grounding via Balanced RL
by: Shen, Jinjie, et al.
Published: (2026)
by: Shen, Jinjie, et al.
Published: (2026)
MetaphorStar: Image Metaphor Understanding and Reasoning with End-to-End Visual Reinforcement Learning
by: Zhang, Chenhao, et al.
Published: (2026)
by: Zhang, Chenhao, et al.
Published: (2026)
PsyDI: Towards a Personalized and Progressively In-depth Chatbot for Psychological Measurements
by: Li, Xueyan, et al.
Published: (2024)
by: Li, Xueyan, et al.
Published: (2024)
BalCapRL: A Balanced Framework for RL-Based MLLM Image Captioning
by: Ye, Shaokai, et al.
Published: (2026)
by: Ye, Shaokai, et al.
Published: (2026)
LLARVA: Vision-Action Instruction Tuning Enhances Robot Learning
by: Niu, Dantong, et al.
Published: (2024)
by: Niu, Dantong, et al.
Published: (2024)
Premover: Fast Vision-Language-Action Control by Acting Before Instructions Are Complete
by: Park, Joonha, et al.
Published: (2026)
by: Park, Joonha, et al.
Published: (2026)
Heat Flows with Prescribed Singularities from 3-dimensional Manifold
by: Ji, Jie, et al.
Published: (2024)
by: Ji, Jie, et al.
Published: (2024)
Omni-Reward: Towards Generalist Omni-Modal Reward Modeling with Free-Form Preferences
by: Jin, Zhuoran, et al.
Published: (2025)
by: Jin, Zhuoran, et al.
Published: (2025)
SIGMA: An Efficient Heterophilous Graph Neural Network with Fast Global Aggregation
by: Liu, Haoyu, et al.
Published: (2023)
by: Liu, Haoyu, et al.
Published: (2023)
Towards Scalable Oversight with Collaborative Multi-Agent Debate in Error Detection
by: Chen, Yongqiang, et al.
Published: (2025)
by: Chen, Yongqiang, et al.
Published: (2025)
Towards Automatic Continual Learning: A Self-Adaptive Framework for Continual Instruction Tuning
by: Lin, Peiyi, et al.
Published: (2025)
by: Lin, Peiyi, et al.
Published: (2025)
OmniNova:A General Multimodal Agent Framework
by: Du, Pengfei
Published: (2025)
by: Du, Pengfei
Published: (2025)
OmniSCV: An Omnidirectional Synthetic Image Generator for Computer Vision
by: Berenguel-Baeta, Bruno, et al.
Published: (2024)
by: Berenguel-Baeta, Bruno, et al.
Published: (2024)
OmniSTVG: Toward Spatio-Temporal Omni-Object Video Grounding
by: Yao, Jiali, et al.
Published: (2025)
by: Yao, Jiali, et al.
Published: (2025)
Proving All-Orders UV Finiteness: Non-Abelian BRST Closure, Analyticity, and Crossing in Omniverse Quantum Field Theory
by: Chiappone, Giovanni
Published: (2025)
by: Chiappone, Giovanni
Published: (2025)
MAny: Merge Anything for Multimodal Continual Instruction Tuning
by: Gao, Zijian, et al.
Published: (2026)
by: Gao, Zijian, et al.
Published: (2026)
Learning to Instruct for Visual Instruction Tuning
by: Zhou, Zhihan, et al.
Published: (2025)
by: Zhou, Zhihan, et al.
Published: (2025)
Effects of Daily Exercise Time on the Academic Performance of Students: An Empirical Analysis Based on CEPS Data
by: Li, Ningyi
Published: (2023)
by: Li, Ningyi
Published: (2023)
An IoT‐based multiple teaching quality evaluation method for English translation with improved deep learning
by: Ningyi Lai
Published: (2024)
by: Ningyi Lai
Published: (2024)
PriorZero: Bridging Language Priors and World Models for Decision Making
by: Xiong, Junyu, et al.
Published: (2026)
by: Xiong, Junyu, et al.
Published: (2026)
CleanS2S: Single-file Framework for Proactive Speech-to-Speech Interaction
by: Lu, Yudong, et al.
Published: (2025)
by: Lu, Yudong, et al.
Published: (2025)
Balancing Continuous Pre-Training and Instruction Fine-Tuning: Optimizing Instruction-Following in LLMs
by: Jindal, Ishan, et al.
Published: (2024)
by: Jindal, Ishan, et al.
Published: (2024)
Balancing Truthfulness and Informativeness with Uncertainty-Aware Instruction Fine-Tuning
by: Wu, Tianyi, et al.
Published: (2025)
by: Wu, Tianyi, et al.
Published: (2025)
Toward Graph-Tokenizing Large Language Models with Reconstructive Graph Instruction Tuning
by: Zhang, Zhongjian, et al.
Published: (2026)
by: Zhang, Zhongjian, et al.
Published: (2026)
$p$-orbital self-organization of ultracold atoms coupled to optical cavities
by: Tan, Hui, et al.
Published: (2025)
by: Tan, Hui, et al.
Published: (2025)
DreamOmni2: Multimodal Instruction-based Editing and Generation
by: Xia, Bin, et al.
Published: (2025)
by: Xia, Bin, et al.
Published: (2025)
CCSS: Hardware-Accelerated RTL Simulation with Fast Combinational Logic Computing and Sequential Logic Synchronization
by: Feng, Weigang, et al.
Published: (2025)
by: Feng, Weigang, et al.
Published: (2025)
B-AVIBench: Towards Evaluating the Robustness of Large Vision-Language Model on Black-box Adversarial Visual-Instructions
by: Zhang, Hao, et al.
Published: (2024)
by: Zhang, Hao, et al.
Published: (2024)
JsonTuning: Towards Generalizable, Robust, and Controllable Instruction Tuning
by: Gao, Chang, et al.
Published: (2023)
by: Gao, Chang, et al.
Published: (2023)
A Survey on Data Selection for LLM Instruction Tuning
by: Zhang, Bolin, et al.
Published: (2024)
by: Zhang, Bolin, et al.
Published: (2024)
Similar Items
-
Hierarchical Balance Packing: Towards Efficient Supervised Fine-tuning for Long-Context LLM
by: Yao, Yongqiang, et al.
Published: (2025) -
OmniGen2: Towards Instruction-Aligned Multimodal Generation
by: Wu, Chenyuan, et al.
Published: (2025) -
HH-Codec: High Compression High-fidelity Discrete Neural Codec for Spoken Language Modeling
by: Xue, Rongkun, et al.
Published: (2025) -
Let Androids Dream of Electric Sheep: A Human-Inspired Image Implication Understanding and Reasoning Framework
by: Zhang, Chenhao, et al.
Published: (2025) -
TreeTensor: Boost AI System on Nested Data with Constrained Tree-Like Tensor
by: Zhang, Shaoang, et al.
Published: (2026)