Imagen de Portada

Recent Advances and Challenges in Deep Audio-Visual Correlation Learning

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Vilaça, Luís, Yu, Yi, Viana, Paula
Formato:	Preprint
Publicado:	2022
Materias:	Multimedia Computer Vision and Pattern Recognition Information Retrieval Machine Learning Audio and Speech Processing 68T99
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

A Survey of Recent Advances and Challenges in Deep Audio-Visual Correlation Learning
por: Vilaca, Luis, et al.
Publicado: (2024)

Anchor-aware Deep Metric Learning for Audio-visual Retrieval
por: Zeng, Donghuo, et al.
Publicado: (2024)

Metric Learning with Progressive Self-Distillation for Audio-Visual Embedding Learning
por: Zeng, Donghuo, et al.
Publicado: (2025)

Audio Does Matter: Importance-Aware Multi-Granularity Fusion for Video Moment Retrieval
por: Lin, Junan, et al.
Publicado: (2025)

Quality Over Quantity? LLM-Based Curation for a Data-Efficient Audio-Video Foundation Model
por: Vosoughi, Ali, et al.
Publicado: (2025)

Diff4Steer: Steerable Diffusion Prior for Generative Music Retrieval with Semantic Guidance
por: Bao, Xuchan, et al.
Publicado: (2024)

On the Effect of Data-Augmentation on Local Embedding Properties in the Contrastive Learning of Music Audio Representations
por: McCallum, Matthew C., et al.
Publicado: (2024)

TalkPlay-Tools: Conversational Music Recommendation with LLM Tool Calling
por: Doh, Seungheon, et al.
Publicado: (2025)

Enriching Music Descriptions with a Finetuned-LLM and Metadata for Text-to-Music Retrieval
por: Doh, SeungHeon, et al.
Publicado: (2024)

JEPOO: Highly Accurate Joint Estimation of Pitch, Onset and Offset for Music Information Retrieval
por: Wei, Haojie, et al.
Publicado: (2023)

Streaming Piano Transcription Based on Consistent Onset and Offset Decoding with Sustain Pedal Detection
por: Wei, Weixing, et al.
Publicado: (2025)

ASK: Adaptive Self-improving Knowledge Framework for Audio Text Retrieval
por: Fu, Siyuan, et al.
Publicado: (2025)

MERGE -- A Bimodal Audio-Lyrics Dataset for Static Music Emotion Recognition
por: Louro, Pedro Lima, et al.
Publicado: (2024)

SynthTab: Leveraging Synthesized Data for Guitar Tablature Transcription
por: Zang, Yongyi, et al.
Publicado: (2023)

Towards Multilingual Audio-Visual Question Answering
por: Phukan, Orchid Chetia, et al.
Publicado: (2024)

Learning Normal Patterns in Musical Loops
por: Dadman, Shayan, et al.
Publicado: (2025)

Discrepancy-Aware Attention Network for Enhanced Audio-Visual Zero-Shot Learning
por: Yu, RunLin, et al.
Publicado: (2024)

Aligning Sight and Sound: Advanced Sound Source Localization Through Audio-Visual Alignment
por: Senocak, Arda, et al.
Publicado: (2024)

Music Genre Classification: Ensemble Learning with Subcomponents-level Attention
por: Liu, Yichen, et al.
Publicado: (2024)

Classifying Shelf Life Quality of Pineapples by Combining Audio and Visual Features
por: Jiang, Yi-Lu, et al.
Publicado: (2025)

Mitigating Audiovisual Mismatch in Visual-Guide Audio Captioning
por: Xu, Le, et al.
Publicado: (2025)

Learning Self-Supervised Audio-Visual Representations for Sound Recommendations
por: Krishnamurthy, Sudha
Publicado: (2024)

DETECLAP: Enhancing Audio-Visual Representation Learning with Object Information
por: Nakada, Shota, et al.
Publicado: (2024)

M2D-CLAP: Masked Modeling Duo Meets CLAP for Learning General-purpose Audio-Language Representation
por: Niizumi, Daisuke, et al.
Publicado: (2024)

PEAVS: Perceptual Evaluation of Audio-Visual Synchrony Grounded in Viewers' Opinion Scores
por: Goncalves, Lucas, et al.
Publicado: (2024)

Benchmarking Cross-Domain Audio-Visual Deception Detection
por: Guo, Xiaobao, et al.
Publicado: (2024)

Spiking Tucker Fusion Transformer for Audio-Visual Zero-Shot Learning
por: Li, Wenrui, et al.
Publicado: (2024)

Multimodal Transformer Distillation for Audio-Visual Synchronization
por: Chen, Xuanjun, et al.
Publicado: (2022)

3D Audio-Visual Segmentation
por: Sokolov, Artem, et al.
Publicado: (2024)

AV-SUPERB: A Multi-Task Evaluation Benchmark for Audio-Visual Representation Models
por: Tseng, Yuan, et al.
Publicado: (2023)

Audio-Vision Contrastive Learning for Phonological Class Recognition
por: Liu, Daiqi, et al.
Publicado: (2025)

Pilot-guided Multimodal Semantic Communication for Audio-Visual Event Localization
por: Yu, Fei, et al.
Publicado: (2024)

A Dataset and Baselines for Measuring and Predicting the Music Piece Memorability
por: Tseng, Li-Yang, et al.
Publicado: (2024)

TalkPlayData 2: An Agentic Synthetic Data Pipeline for Multimodal Conversational Music Recommendation
por: Choi, Keunwoo, et al.
Publicado: (2025)

AlignVSR: Audio-Visual Cross-Modal Alignment for Visual Speech Recognition
por: Liu, Zehua, et al.
Publicado: (2024)

Multifaceted Evaluation of Audio-Visual Capability for MLLMs: Effectiveness, Efficiency, Generalizability and Robustness
por: Zhao, Yusheng, et al.
Publicado: (2025)

SNIFR : Boosting Fine-Grained Child Harmful Content Detection Through Audio-Visual Alignment with Cascaded Cross-Transformer
por: Phukan, Orchid Chetia, et al.
Publicado: (2025)

Detecting Audio-Visual Deepfakes with Fine-Grained Inconsistencies
por: Astrid, Marcella, et al.
Publicado: (2024)

AD-AVSR: Asymmetric Dual-stream Enhancement for Robust Audio-Visual Speech Recognition
por: Xue, Junxiao, et al.
Publicado: (2025)

AV2AV: Direct Audio-Visual Speech to Audio-Visual Speech Translation with Unified Audio-Visual Speech Representation
por: Choi, Jeongsoo, et al.
Publicado: (2023)