BRACE: A Benchmark for Robust Audio Caption Quality Evaluation
Fuente:
arXiv
Guardado en:
| Autores principales: | Guo, Tianyu, Chen, Hongyu, Liang, Hao, Qiang, Meiyi, Zeng, Bohan, Sun, Linzhuang, Cui, Bin, Zhang, Wentao |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
The Interspeech 2026 Audio Reasoning Challenge: Evaluating Reasoning Process Quality for Audio Reasoning Models and Agents
por: Ma, Ziyang, et al.
Publicado: (2026)
por: Ma, Ziyang, et al.
Publicado: (2026)
Bagpiper: Solving Open-Ended Audio Tasks via Rich Captions
por: Tian, Jinchuan, et al.
Publicado: (2026)
por: Tian, Jinchuan, et al.
Publicado: (2026)
Enhancing Automated Audio Captioning via Large Language Models with Optimized Audio Encoding
por: Liu, Jizhong, et al.
Publicado: (2024)
por: Liu, Jizhong, et al.
Publicado: (2024)
VABench: A Comprehensive Benchmark for Audio-Video Generation
por: Hua, Daili, et al.
Publicado: (2025)
por: Hua, Daili, et al.
Publicado: (2025)
CAF-Score: Calibrating CLAP with LALMs for Reference-free Audio Captioning Evaluation
por: Lee, Insung, et al.
Publicado: (2026)
por: Lee, Insung, et al.
Publicado: (2026)
AudioBench: A Universal Benchmark for Audio Large Language Models
por: Wang, Bin, et al.
Publicado: (2024)
por: Wang, Bin, et al.
Publicado: (2024)
ISA-Bench: Benchmarking Instruction Sensitivity for Large Audio Language Models
por: Li, Bohan, et al.
Publicado: (2025)
por: Li, Bohan, et al.
Publicado: (2025)
VCB Bench: An Evaluation Benchmark for Audio-Grounded Large Language Model Conversational Agents
por: Hu, Jiliang, et al.
Publicado: (2025)
por: Hu, Jiliang, et al.
Publicado: (2025)
SonicBench: Dissecting the Physical Perception Bottleneck in Large Audio Language Models
por: Sun, Yirong, et al.
Publicado: (2026)
por: Sun, Yirong, et al.
Publicado: (2026)
Audio Large Language Models Can Be Descriptive Speech Quality Evaluators
por: Chen, Chen, et al.
Publicado: (2025)
por: Chen, Chen, et al.
Publicado: (2025)
K12-KGraph: A Curriculum-Aligned Knowledge Graph for Benchmarking and Training Educational LLMs
por: Liang, Hao, et al.
Publicado: (2026)
por: Liang, Hao, et al.
Publicado: (2026)
CASTELLA: Long Audio Dataset with Captions and Temporal Boundaries
por: Munakata, Hokuto, et al.
Publicado: (2025)
por: Munakata, Hokuto, et al.
Publicado: (2025)
video-SALMONN 2: Caption-Enhanced Audio-Visual Large Language Models
por: Tang, Changli, et al.
Publicado: (2025)
por: Tang, Changli, et al.
Publicado: (2025)
Words at Play: Benchmarking Audio Pun Understanding in Large Audio-Language Models
por: Su, Yuchen, et al.
Publicado: (2026)
por: Su, Yuchen, et al.
Publicado: (2026)
RECAP: Retrieval-Augmented Audio Captioning
por: Ghosh, Sreyan, et al.
Publicado: (2023)
por: Ghosh, Sreyan, et al.
Publicado: (2023)
Omni-Embed-Audio: Leveraging Multimodal LLMs for Robust Audio-Text Retrieval
por: Yoo, HaeJun, et al.
Publicado: (2026)
por: Yoo, HaeJun, et al.
Publicado: (2026)
Improving Text-To-Audio Models with Synthetic Captions
por: Kong, Zhifeng, et al.
Publicado: (2024)
por: Kong, Zhifeng, et al.
Publicado: (2024)
CLAIR-A: Leveraging Large Language Models to Judge Audio Captions
por: Wu, Tsung-Han, et al.
Publicado: (2024)
por: Wu, Tsung-Han, et al.
Publicado: (2024)
BASS: Benchmarking Audio LMs for Musical Structure and Semantic Reasoning
por: Jang, Min, et al.
Publicado: (2026)
por: Jang, Min, et al.
Publicado: (2026)
Audio Jailbreaks in Large Audio-Language Models: Taxonomy, Attack-Defense Analysis, and Cost-Aware Evaluation
por: Feng, Bo-Han, et al.
Publicado: (2026)
por: Feng, Bo-Han, et al.
Publicado: (2026)
Kling-Foley: Multimodal Diffusion Transformer for High-Quality Video-to-Audio Generation
por: Wang, Jun, et al.
Publicado: (2025)
por: Wang, Jun, et al.
Publicado: (2025)
PARSA-Bench: A Comprehensive Persian Audio-Language Model Benchmark
por: Kalahroodi, Mohammad Javad Ranjbar, et al.
Publicado: (2026)
por: Kalahroodi, Mohammad Javad Ranjbar, et al.
Publicado: (2026)
Audio-DeepThinker: Progressive Reasoning-Aware Reinforcement Learning for High-Quality Chain-of-Thought Emergence in Audio Language Models
por: He, Xiang, et al.
Publicado: (2026)
por: He, Xiang, et al.
Publicado: (2026)
ChronosAudio: A Comprehensive Long-Audio Benchmark for Evaluating Audio-Large Language Models
por: Luo, Kaiwen, et al.
Publicado: (2026)
por: Luo, Kaiwen, et al.
Publicado: (2026)
AlignCap: Aligning Speech Emotion Captioning to Human Preferences
por: Liang, Ziqi, et al.
Publicado: (2024)
por: Liang, Ziqi, et al.
Publicado: (2024)
An Evaluation of Interleaved Instruction Tuning on Semantic Reasoning Performance in an Audio MLLM
por: Liu, Jiawei, et al.
Publicado: (2025)
por: Liu, Jiawei, et al.
Publicado: (2025)
EchoDistill:Alignment Noisy-to-Clean Self-Distillation for Robust Audio LLMs
por: Lin, Liang, et al.
Publicado: (2026)
por: Lin, Liang, et al.
Publicado: (2026)
AVCap: Leveraging Audio-Visual Features as Text Tokens for Captioning
por: Kim, Jongsuk, et al.
Publicado: (2024)
por: Kim, Jongsuk, et al.
Publicado: (2024)
TAC: Timestamped Audio Captioning
por: Kumar, Sonal, et al.
Publicado: (2026)
por: Kumar, Sonal, et al.
Publicado: (2026)
Robust Audio-Text Retrieval via Cross-Modal Attention and Hybrid Loss
por: Liu, Meizhu, et al.
Publicado: (2026)
por: Liu, Meizhu, et al.
Publicado: (2026)
Causal Tracing of Audio-Text Fusion in Large Audio Language Models
por: Chen, Wei-Chih, et al.
Publicado: (2026)
por: Chen, Wei-Chih, et al.
Publicado: (2026)
Beyond Transcription: Unified Audio Schema for Perception-Aware AudioLLMs
por: Zhang, Linhao, et al.
Publicado: (2026)
por: Zhang, Linhao, et al.
Publicado: (2026)
WavCaps: A ChatGPT-Assisted Weakly-Labelled Audio Captioning Dataset for Audio-Language Multimodal Research
por: Mei, Xinhao, et al.
Publicado: (2023)
por: Mei, Xinhao, et al.
Publicado: (2023)
Robust and Efficient Autoregressive Speech Synthesis with Dynamic Chunk-wise Prediction Policy
por: Li, Bohan, et al.
Publicado: (2025)
por: Li, Bohan, et al.
Publicado: (2025)
Resource-Efficient Reference-Free Evaluation of Audio Captions
por: Mahfuz, Rehana, et al.
Publicado: (2024)
por: Mahfuz, Rehana, et al.
Publicado: (2024)
CMDAR: A Chinese Multi-scene Dynamic Audio Reasoning Benchmark with Diverse Challenges
por: Li, Hui, et al.
Publicado: (2025)
por: Li, Hui, et al.
Publicado: (2025)
MACE: Leveraging Audio for Evaluating Audio Captioning Systems
por: Dixit, Satvik, et al.
Publicado: (2024)
por: Dixit, Satvik, et al.
Publicado: (2024)
AudioCapBench: Quick Evaluation on Audio Captioning across Sound, Music, and Speech
por: Qiu, Jielin, et al.
Publicado: (2026)
por: Qiu, Jielin, et al.
Publicado: (2026)
When Silence Matters: The Impact of Irrelevant Audio on Text Reasoning in Large Audio-Language Models
por: Li, Chen-An, et al.
Publicado: (2025)
por: Li, Chen-An, et al.
Publicado: (2025)
MathClean: A Benchmark for Synthetic Mathematical Data Cleaning
por: Liang, Hao, et al.
Publicado: (2025)
por: Liang, Hao, et al.
Publicado: (2025)
Ejemplares similares
-
The Interspeech 2026 Audio Reasoning Challenge: Evaluating Reasoning Process Quality for Audio Reasoning Models and Agents
por: Ma, Ziyang, et al.
Publicado: (2026) -
Bagpiper: Solving Open-Ended Audio Tasks via Rich Captions
por: Tian, Jinchuan, et al.
Publicado: (2026) -
Enhancing Automated Audio Captioning via Large Language Models with Optimized Audio Encoding
por: Liu, Jizhong, et al.
Publicado: (2024) -
VABench: A Comprehensive Benchmark for Audio-Video Generation
por: Hua, Daili, et al.
Publicado: (2025) -
CAF-Score: Calibrating CLAP with LALMs for Reference-free Audio Captioning Evaluation
por: Lee, Insung, et al.
Publicado: (2026)