Imagen de Portada

Can You Count to Nine? A Human Evaluation Benchmark for Counting Limits in Modern Text-to-Video Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Guo, Xuyang, Huang, Zekai, Huo, Jiayan, Liang, Yingyu, Shi, Zhenmei, Song, Zhao, Zhang, Jiahao
Formato:	Preprint
Publicado:	2025
Materias:	Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Text-to-Image Diffusion Models Cannot Count, and Prompt Refinement Cannot Help
por: Guo, Xuyang, et al.
Publicado: (2025)

Your Vision-Language Model Can't Even Count to 20: Exposing the Failures of VLMs in Compositional Counting
por: Guo, Xuyang, et al.
Publicado: (2025)

T2VTextBench: A Human Evaluation Benchmark for Textual Control in Video Generation Models
por: Guo, Xuyang, et al.
Publicado: (2025)

T2VPhysBench: A First-Principles Benchmark for Physical Consistency in Text-to-Video Generation
por: Guo, Xuyang, et al.
Publicado: (2025)

T2VWorldBench: A Benchmark for Evaluating World Knowledge in Text-to-Video Generation
por: Chen, Yubin, et al.
Publicado: (2025)

RoPE Attention Can Be Trained in Almost Linear Time
por: Cao, Yang, et al.
Publicado: (2024)

RichSpace: Enriching Text-to-Video Prompt Space via Text Embedding Interpolation
por: Cao, Yuefan, et al.
Publicado: (2025)

Unraveling the Smoothness Properties of Diffusion Models: A Gaussian Mixture Perspective
por: Liang, Yingyu, et al.
Publicado: (2024)

Neural Algorithmic Reasoning for Hypergraphs with Looped Transformers
por: Huang, Zekai, et al.
Publicado: (2025)

On Computational Limits and Provably Efficient Criteria of Visual Autoregressive Models: A Fine-Grained Complexity Analysis
por: Ke, Yekun, et al.
Publicado: (2025)

HOFAR: High-Order Augmentation of Flow Autoregressive Transformers
por: Liang, Yingyu, et al.
Publicado: (2025)

Universal Approximation of Visual Autoregressive Transformers
por: Chen, Yifang, et al.
Publicado: (2025)

When Can We Solve the Weighted Low Rank Approximation Problem in Truly Subquadratic Time?
por: Li, Chenyang, et al.
Publicado: (2025)

Count What You Want: Exemplar Identification and Few-shot Counting of Human Actions in the Wild
por: Huang, Yifeng, et al.
Publicado: (2023)

On Computational Limits of FlowAR Models: Expressivity and Efficiency
por: Cao, Yang, et al.
Publicado: (2025)

Scaling Law Phenomena Across Regression Paradigms: Multiple and Kernel Approaches
por: Chen, Yifang, et al.
Publicado: (2025)

Do Large Language Models Have Compositional Ability? An Investigation into Limitations and Scalability
por: Xu, Zhuoyan, et al.
Publicado: (2024)

UNICBench: UNIfied Counting Benchmark for MLLM
por: Rong, Chenggang, et al.
Publicado: (2026)

Visual Autoregressive Transformers Must Use $Ω(n^2 d)$ Memory
por: Cao, Yang, et al.
Publicado: (2025)

Looped ReLU MLPs May Be All You Need as Practical Programmable Computers
por: Liang, Yingyu, et al.
Publicado: (2024)

Provable Differentially Private Computation of the Cross-Attention Mechanism
por: Ke, Yekun, et al.
Publicado: (2024)

Multi-Layer Transformers Gradient Can be Approximated in Almost Linear Time
por: Liang, Yingyu, et al.
Publicado: (2024)

The Computational Limits of State-Space Models and Mamba via the Lens of Circuit Complexity
por: Chen, Yifang, et al.
Publicado: (2024)

Dissecting Submission Limit in Desk-Rejections: A Mathematical Analysis of Fairness in AI Conference Policies
por: Cao, Yuefan, et al.
Publicado: (2025)

CountDiffusion: Text-to-Image Synthesis with Training-Free Counting-Guidance Diffusion
por: Li, Yanyu, et al.
Publicado: (2025)

Can Language Models Compose Skills In-Context?
por: Liu, Zidong, et al.
Publicado: (2025)

Can Current AI Models Count What We Mean, Not What They See? A Benchmark and Systematic Evaluation
por: Nguyen, Gia Khanh, et al.
Publicado: (2025)

Theoretical Guarantees for High Order Trajectory Refinement in Generative Flows
por: Gong, Chengyue, et al.
Publicado: (2025)

Too Easily Fooled? Prompt Injection Breaks LLMs on Frustratingly Simple Multiple-Choice Questions
por: Guo, Xuyang, et al.
Publicado: (2025)

On Fine-Grained I/O Complexity of Attention Backward Passes
por: Li, Xiaoyu, et al.
Publicado: (2024)

Exploring the Frontiers of Softmax: Provable Optimization, Applications in Diffusion Model, and Beyond
por: Cao, Yang, et al.
Publicado: (2024)

Training Tensor Attention Efficiently: From Cubic to Almost Linear Time
por: Cao, Yang, et al.
Publicado: (2024)

Towards Infinite-Long Prefix in Transformer
por: Liang, Yingyu, et al.
Publicado: (2024)

A Tighter Complexity Analysis of SparseGPT
por: Li, Xiaoyu, et al.
Publicado: (2024)

VCBench: A Streaming Counting Benchmark for Spatial-Temporal State Maintenance in Long Videos
por: Liu, Pengyiang, et al.
Publicado: (2026)

Modern Hopfield Networks Require Chain-of-Thought to Solve $\mathsf{NC}^1$-Hard Problems
por: Cao, Yang, et al.
Publicado: (2024)

YOLO-Count: Differentiable Object Counting for Text-to-Image Generation
por: Zeng, Guanning, et al.
Publicado: (2025)

Text-promptable Object Counting via Quantity Awareness Enhancement
por: Shi, Miaojing, et al.
Publicado: (2025)

EC-Bench: Enumeration and Counting Benchmark for Ultra-Long Videos
por: Tsuchiya, Fumihiko, et al.
Publicado: (2026)

FocalCount: Towards Class-Count Imbalance in Class-Agnostic Counting
por: Zhu, Huilin, et al.
Publicado: (2025)