Imagen de Portada

FoleyDirector: Fine-Grained Temporal Steering for Video-to-Audio Generation via Structured Scripts

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Li, You, Zhou, Dewei, Ma, Fan, Li, Fu, He, Dongliang, Yang, Yi
Formato:	Preprint
Publicado:	2026
Materias:	Sound Computer Vision and Pattern Recognition
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

DreamFoley: Scalable VLMs for High-Fidelity Video-to-Audio Generation
por: Li, Fu, et al.
Publicado: (2025)

HunyuanVideo-Foley: Multimodal Diffusion with Representation Alignment for High-Fidelity Foley Audio Generation
por: Shan, Sizhe, et al.
Publicado: (2025)

FoleySpace: Vision-Aligned Binaural Spatial Audio Generation
por: Zhao, Lei, et al.
Publicado: (2025)

Video-to-Audio Generation with Fine-grained Temporal Semantics
por: Hu, Yuchen, et al.
Publicado: (2024)

StereoFoley: Object-Aware Stereo Audio Generation from Video
por: Karchkhadze, Tornike, et al.
Publicado: (2025)

Rhythmic Foley: A Framework For Seamless Audio-Visual Alignment In Video-to-Audio Synthesis
por: Huang, Zhiqi, et al.
Publicado: (2024)

Video-Foley: Two-Stage Video-To-Sound Generation via Temporal Event Condition For Foley Sound
por: Lee, Junwon, et al.
Publicado: (2024)

Kling-Foley: Multimodal Diffusion Transformer for High-Quality Video-to-Audio Generation
por: Wang, Jun, et al.
Publicado: (2025)

FoleyBench: A Benchmark For Video-to-Audio Models
por: Dixit, Satvik, et al.
Publicado: (2025)

SpotSound: Enhancing Large Audio-Language Models with Fine-Grained Temporal Grounding
por: Sun, Luoyi, et al.
Publicado: (2026)

Audio ControlNet for Fine-Grained Audio Generation and Editing
por: Zhu, Haina, et al.
Publicado: (2026)

AC-Foley: Reference-Audio-Guided Video-to-Audio Synthesis with Acoustic Transfer
por: Fang, Pengjun, et al.
Publicado: (2026)

ControlFoley: Unified and Controllable Video-to-Audio Generation with Cross-Modal Conflict Handling
por: Yang, Jianxuan, et al.
Publicado: (2026)

Smooth-Foley: Creating Continuous Sound for Video-to-Audio Generation Under Semantic Guidance
por: Zhang, Yaoyun, et al.
Publicado: (2024)

Foley Control: Aligning a Frozen Latent Text-to-Audio Model to Video
por: Rowles, Ciara, et al.
Publicado: (2025)

EmoSteer-TTS: Fine-Grained and Training-Free Emotion-Controllable Text-to-Speech via Activation Steering
por: Xie, Tianxin, et al.
Publicado: (2025)

FoleyGRAM: Video-to-Audio Generation with GRAM-Aligned Multimodal Encoders
por: Gramaccioni, Riccardo Fosco, et al.
Publicado: (2025)

SegTune: Structured and Fine-Grained Control for Song Generation
por: Cai, Pengfei, et al.
Publicado: (2025)

MambaFoley: Foley Sound Generation using Selective State-Space Models
por: Colombo, Marco Furio, et al.
Publicado: (2024)

FineLAP: Taming Heterogeneous Supervision for Fine-grained Language-Audio Pretraining
por: Li, Xiquan, et al.
Publicado: (2026)

Foley-Flow: Coordinated Video-to-Audio Generation with Masked Audio-Visual Alignment and Dynamic Conditional Flows
por: Mo, Shentong, et al.
Publicado: (2026)

SARSteer: Safeguarding Large Audio-Language Models via Safe-Ablated Refusal Steering
por: Lin, Weilin, et al.
Publicado: (2025)

Video-Guided Foley Sound Generation with Multimodal Controls
por: Chen, Ziyang, et al.
Publicado: (2024)

SpecMaskFoley: Steering Pretrained Spectral Masked Generative Transformer Toward Synchronized Video-to-audio Synthesis via ControlNet
por: Zhong, Zhi, et al.
Publicado: (2025)

Audio Palette: A Diffusion Transformer with Multi-Signal Conditioning for Controllable Foley Synthesis
por: Wang, Junnuo
Publicado: (2025)

MTAVG-Bench: A Diagnostic Benchmark for Multi-Talker Dialogue-Centric Audio-Video Generation
por: Zhou, Yang-Hao, et al.
Publicado: (2026)

MINT: a Multi-modal Image and Narrative Text Dubbing Dataset for Foley Audio Content Planning and Generation
por: Fu, Ruibo, et al.
Publicado: (2024)

Resonate: Reinforcing Text-to-Audio Generation via Online Feedback from Large Audio Language Models
por: Li, Xiquan, et al.
Publicado: (2026)

Fine-Grained Quantitative Emotion Editing for Speech Generation
por: Inoue, Sho, et al.
Publicado: (2024)

AuDirector: A Self-Reflective Closed-Loop Framework for Immersive Audio Storytelling
por: Ren, Yiming, et al.
Publicado: (2026)

STA-V2A: Video-to-Audio Generation with Semantic and Temporal Alignment
por: Ren, Yong, et al.
Publicado: (2024)

PhyAVBench: A Challenging Audio Physics-Sensitivity Benchmark for Physically Grounded Text-to-Audio-Video Generation
por: Xie, Tianxin, et al.
Publicado: (2025)

Listening Between the Frames: Bridging Temporal Gaps in Large Audio-Language Models
por: Wang, Hualei, et al.
Publicado: (2025)

Are Audio-Language Models Listening? Audio-Specialist Heads for Adaptive Audio Steering
por: Glazer, Neta, et al.
Publicado: (2026)

FolAI: Synchronized Foley Sound Generation with Semantic and Temporal Alignment
por: Gramaccioni, Riccardo Fosco, et al.
Publicado: (2024)

MOVA: Towards Scalable and Synchronized Video-Audio Generation
por: OpenMOSS Team, et al.
Publicado: (2026)

Efficient Video to Audio Mapper with Visual Scene Detection
por: Yi, Mingjing, et al.
Publicado: (2024)

MeanFlow-Accelerated Multimodal Video-to-Audio Synthesis via One-Step Generation
por: Yang, Xiaoran, et al.
Publicado: (2025)

AudioComposer: Towards Fine-grained Audio Generation with Natural Language Descriptions
por: Wang, Yuanyuan, et al.
Publicado: (2024)

Detecting and Mitigating Insertion Hallucination in Video-to-Audio Generation
por: Chen, Liyang, et al.
Publicado: (2025)