ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignment
Fuente:
arXiv
Saved in:
| Main Authors: | Hu, Xiwei, Wang, Rui, Fang, Yixiao, Fu, Bin, Cheng, Pei, Yu, Gang |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
LinguaLinker: Audio-Driven Portraits Animation with Implicit Facial Control Enhancement
by: Zhang, Rui, et al.
Published: (2024)
by: Zhang, Rui, et al.
Published: (2024)
EMMA: Your Text-to-Image Diffusion Model Can Secretly Accept Multi-Modal Prompts
by: Han, Yucheng, et al.
Published: (2024)
by: Han, Yucheng, et al.
Published: (2024)
SARA: Semantically Adaptive Relational Alignment for Video Diffusion Models
by: Lian, Jiesong, et al.
Published: (2026)
by: Lian, Jiesong, et al.
Published: (2026)
Masked Conditional Diffusion Model for Enhancing Deepfake Detection
by: Chen, Tiewen, et al.
Published: (2024)
by: Chen, Tiewen, et al.
Published: (2024)
Cross-Modal Scene Semantic Alignment for Image Complexity Assessment
by: Luo, Yuqing, et al.
Published: (2025)
by: Luo, Yuqing, et al.
Published: (2025)
Equipping Diffusion Models with Differentiable Spatial Entropy for Low-Light Image Enhancement
by: Lian, Wenyi, et al.
Published: (2024)
by: Lian, Wenyi, et al.
Published: (2024)
Noise Diffusion for Enhancing Semantic Faithfulness in Text-to-Image Synthesis
by: Miao, Boming, et al.
Published: (2024)
by: Miao, Boming, et al.
Published: (2024)
Token Pruning for In-Context Generation in Diffusion Transformers
by: Lin, Junqing, et al.
Published: (2026)
by: Lin, Junqing, et al.
Published: (2026)
OneIG-Bench: Omni-dimensional Nuanced Evaluation for Image Generation
by: Chang, Jingjing, et al.
Published: (2025)
by: Chang, Jingjing, et al.
Published: (2025)
Unifying Visual and Semantic Feature Spaces with Diffusion Models for Enhanced Cross-Modal Alignment
by: Zheng, Yuze, et al.
Published: (2024)
by: Zheng, Yuze, et al.
Published: (2024)
DiCLIP: Diffusion Model Enhances CLIP's Dense Knowledge for Weakly Supervised Semantic Segmentation
by: Yang, Zhiwei, et al.
Published: (2026)
by: Yang, Zhiwei, et al.
Published: (2026)
$Z^2$-Sampling: Zero-Cost Zigzag Trajectories for Semantic Alignment in Diffusion Models
by: Li, Haosen, et al.
Published: (2026)
by: Li, Haosen, et al.
Published: (2026)
StarVid: Enhancing Semantic Alignment in Video Diffusion Models via Spatial and SynTactic Guided Attention Refocusing
by: Li, Yuanhang, et al.
Published: (2024)
by: Li, Yuanhang, et al.
Published: (2024)
Structure Matters: Tackling the Semantic Discrepancy in Diffusion Models for Image Inpainting
by: Liu, Haipeng, et al.
Published: (2024)
by: Liu, Haipeng, et al.
Published: (2024)
Semantic-Space-Intervened Diffusive Alignment for Visual Classification
by: Li, Zixuan, et al.
Published: (2025)
by: Li, Zixuan, et al.
Published: (2025)
MonoInstance: Enhancing Monocular Priors via Multi-view Instance Alignment for Neural Rendering and Reconstruction
by: Zhang, Wenyuan, et al.
Published: (2025)
by: Zhang, Wenyuan, et al.
Published: (2025)
PointDiffuse: A Dual-Conditional Diffusion Model for Enhanced Point Cloud Semantic Segmentation
by: He, Yong, et al.
Published: (2025)
by: He, Yong, et al.
Published: (2025)
DMAligner: Enhancing Image Alignment via Diffusion Model Based View Synthesis
by: Luo, Xinglong, et al.
Published: (2026)
by: Luo, Xinglong, et al.
Published: (2026)
When and What: Diffusion-Grounded VideoLLM with Entity Aware Segmentation for Long Video Understanding
by: Fang, Pengcheng, et al.
Published: (2025)
by: Fang, Pengcheng, et al.
Published: (2025)
Semantic Alignment for Multimodal Large Language Models
by: Wu, Tao, et al.
Published: (2024)
by: Wu, Tao, et al.
Published: (2024)
Visual-Semantic Decomposition and Partial Alignment for Document-based Zero-Shot Learning
by: Qu, Xiangyan, et al.
Published: (2024)
by: Qu, Xiangyan, et al.
Published: (2024)
What Semantics Survive the Connector? Diagnosing VLM-to-DiT Alignment in Video Editing
by: Lin, Hangyu, et al.
Published: (2026)
by: Lin, Hangyu, et al.
Published: (2026)
Unleashing the Potential of the Semantic Latent Space in Diffusion Models for Image Dehazing
by: Yang, Zizheng, et al.
Published: (2025)
by: Yang, Zizheng, et al.
Published: (2025)
Enhancing Diffusion-based Unrestricted Adversarial Attacks via Adversary Preferences Alignment
by: Jiang, Kaixun, et al.
Published: (2025)
by: Jiang, Kaixun, et al.
Published: (2025)
WithAnyone: Towards Controllable and ID Consistent Image Generation
by: Xu, Hengyuan, et al.
Published: (2025)
by: Xu, Hengyuan, et al.
Published: (2025)
Geometry Reinforced Efficient Attention Tuning Equipped with Normals for Robust Stereo Matching
by: Li, Jiahao, et al.
Published: (2026)
by: Li, Jiahao, et al.
Published: (2026)
Frequency-Enhanced Diffusion Models: Curriculum-Guided Semantic Alignment for Zero-Shot Skeleton Action Recognition
by: Zhou, Yuxi, et al.
Published: (2026)
by: Zhou, Yuxi, et al.
Published: (2026)
MVPaint: Synchronized Multi-View Diffusion for Painting Anything 3D
by: Cheng, Wei, et al.
Published: (2024)
by: Cheng, Wei, et al.
Published: (2024)
SChanger: Change Detection from a Semantic Change and Spatial Consistency Perspective
by: Zhou, Ziyu, et al.
Published: (2025)
by: Zhou, Ziyu, et al.
Published: (2025)
Intention Enhanced Diffusion Model for Multimodal Pedestrian Trajectory Prediction
by: Liu, Yu, et al.
Published: (2025)
by: Liu, Yu, et al.
Published: (2025)
SemanticStitch: Enhancing Image Coherence through Foreground-Aware Seam Carving
by: Jin, Ji-Ping, et al.
Published: (2025)
by: Jin, Ji-Ping, et al.
Published: (2025)
Breaking Alignment Barriers: TPS-Driven Semantic Correlation Learning for Alignment-Free RGB-T Salient Object Detection
by: Hu, Lupiao, et al.
Published: (2025)
by: Hu, Lupiao, et al.
Published: (2025)
MTADiffusion: Mask Text Alignment Diffusion Model for Object Inpainting
by: Huang, Jun, et al.
Published: (2025)
by: Huang, Jun, et al.
Published: (2025)
MM-RLHF: The Next Step Forward in Multimodal LLM Alignment
by: Zhang, Yi-Fan, et al.
Published: (2025)
by: Zhang, Yi-Fan, et al.
Published: (2025)
Large Language Model-Guided Semantic Alignment for Human Activity Recognition
by: Yan, Hua, et al.
Published: (2024)
by: Yan, Hua, et al.
Published: (2024)
SAMA: Factorized Semantic Anchoring and Motion Alignment for Instruction-Guided Video Editing
by: Zhang, Xinyao, et al.
Published: (2026)
by: Zhang, Xinyao, et al.
Published: (2026)
COAL: Counterfactual and Observation-Enhanced Alignment Learning for Discriminative Referring Multi-Object Tracking
by: Jia, Shukun, et al.
Published: (2026)
by: Jia, Shukun, et al.
Published: (2026)
Equipping Vision Foundation Model with Mixture of Experts for Out-of-Distribution Detection
by: Zhao, Shizhen, et al.
Published: (2025)
by: Zhao, Shizhen, et al.
Published: (2025)
Guiding Diffusion Models with Semantically Degraded Conditions
by: Han, Shilong, et al.
Published: (2026)
by: Han, Shilong, et al.
Published: (2026)
Federated Dialogue-Semantic Diffusion for Emotion Recognition under Incomplete Modalities
by: Qiu, Xihang, et al.
Published: (2025)
by: Qiu, Xihang, et al.
Published: (2025)
Similar Items
-
LinguaLinker: Audio-Driven Portraits Animation with Implicit Facial Control Enhancement
by: Zhang, Rui, et al.
Published: (2024) -
EMMA: Your Text-to-Image Diffusion Model Can Secretly Accept Multi-Modal Prompts
by: Han, Yucheng, et al.
Published: (2024) -
SARA: Semantically Adaptive Relational Alignment for Video Diffusion Models
by: Lian, Jiesong, et al.
Published: (2026) -
Masked Conditional Diffusion Model for Enhancing Deepfake Detection
by: Chen, Tiewen, et al.
Published: (2024) -
Cross-Modal Scene Semantic Alignment for Image Complexity Assessment
by: Luo, Yuqing, et al.
Published: (2025)