Length-Aware Multi-Kernel Transformer for Long Document Classification
Fuente:
arXiv
Saved in:
| Main Authors: | Han, Guangzeng, Tsao, Jack, Huang, Xiaolei |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Examining and Adapting Time for Multilingual Classification via Mixture of Temporal Experts
by: Liu, Weisi, et al.
Published: (2025)
by: Liu, Weisi, et al.
Published: (2025)
What Makes Good Instruction-Tuning Data? An In-Context Learning Perspective
by: Han, Guangzeng, et al.
Published: (2026)
by: Han, Guangzeng, et al.
Published: (2026)
Attributes as Textual Genes: Leveraging LLMs as Genetic Algorithm Simulators for Conditional Synthetic Data Generation
by: Han, Guangzeng, et al.
Published: (2025)
by: Han, Guangzeng, et al.
Published: (2025)
Knowledge-driven Augmentation and Retrieval for Integrative Temporal Adaptation
by: Liu, Weisi, et al.
Published: (2026)
by: Liu, Weisi, et al.
Published: (2026)
Model-Agnostic Meta Learning for Class Imbalance Adaptation
by: Rao, Hanshu, et al.
Published: (2026)
by: Rao, Hanshu, et al.
Published: (2026)
Chain-of-Interaction: Enhancing Large Language Models for Psychiatric Behavior Understanding by Dyadic Contexts
by: Han, Guangzeng, et al.
Published: (2024)
by: Han, Guangzeng, et al.
Published: (2024)
Leveraging Multimodal Self-Consistency Reasoning in Coding Motivational Interviewing for Alcohol Use Reduction
by: Han, Guangzeng, et al.
Published: (2026)
by: Han, Guangzeng, et al.
Published: (2026)
Document Structure in Long Document Transformers
by: Buchmann, Jan, et al.
Published: (2024)
by: Buchmann, Jan, et al.
Published: (2024)
From UAV Imagery to Agronomic Reasoning: A Multimodal LLM Benchmark for Plant Phenotyping
by: Wu, Yu, et al.
Published: (2026)
by: Wu, Yu, et al.
Published: (2026)
Cultivating Multidisciplinary AI Workforce Development on iTiger GPU Cluster: Practices and Challenges
by: Sharif, Mayira, et al.
Published: (2025)
by: Sharif, Mayira, et al.
Published: (2025)
LaPA$^2$: Length-Aware Prefix and Prompt Attention Augmentation for Long-Form Controllable Text Generation
by: Yang, Jiabing, et al.
Published: (2025)
by: Yang, Jiabing, et al.
Published: (2025)
Fusion Matters: Length-Aware Analysis of Positional-Encoding Fusion in Transformers
by: Hallam, Mohamed Amine, et al.
Published: (2026)
by: Hallam, Mohamed Amine, et al.
Published: (2026)
Context-Aware Hierarchical Merging for Long Document Summarization
by: Ou, Litu, et al.
Published: (2025)
by: Ou, Litu, et al.
Published: (2025)
Length Generalization of Causal Transformers without Position Encoding
by: Wang, Jie, et al.
Published: (2024)
by: Wang, Jie, et al.
Published: (2024)
Extending Automatic Machine Translation Evaluation to Book-Length Documents
by: Wang, Kuang-Da, et al.
Published: (2025)
by: Wang, Kuang-Da, et al.
Published: (2025)
Context-Aware Initialization for Reducing Generative Path Length in Diffusion Language Models
by: Miao, Tongyuan, et al.
Published: (2025)
by: Miao, Tongyuan, et al.
Published: (2025)
Bhaasha, Bhasa, Zaban: A Survey for Low-Resourced Languages in South Asia -- Current Stage and Challenges
by: Poria, Sampoorna, et al.
Published: (2025)
by: Poria, Sampoorna, et al.
Published: (2025)
An Automated Length-Aware Quality Metric for Summarization
by: Foland, Andrew D.
Published: (2025)
by: Foland, Andrew D.
Published: (2025)
More Documents, Same Length: Isolating the Challenge of Multiple Documents in RAG
by: Levy, Shahar, et al.
Published: (2025)
by: Levy, Shahar, et al.
Published: (2025)
Graph-tree Fusion Model with Bidirectional Information Propagation for Long Document Classification
by: Roy, Sudipta Singha, et al.
Published: (2024)
by: Roy, Sudipta Singha, et al.
Published: (2024)
A Decoding Algorithm for Length-Control Summarization Based on Directed Acyclic Transformers
by: Huang, Chenyang, et al.
Published: (2025)
by: Huang, Chenyang, et al.
Published: (2025)
Investigating Length Issues in Document-level Machine Translation
by: Peng, Ziqian, et al.
Published: (2024)
by: Peng, Ziqian, et al.
Published: (2024)
Multi-domain Multi-modal Document Classification Benchmark with a Multi-level Taxonomy
by: Ma, Denghao, et al.
Published: (2026)
by: Ma, Denghao, et al.
Published: (2026)
Beyond Length: Quantifying Long-Range Information for Long-Context LLM Pretraining Data
by: Deng, Haoran, et al.
Published: (2025)
by: Deng, Haoran, et al.
Published: (2025)
MaLei at MultiClinSUM: Summarisation of Clinical Documents using Perspective-Aware Iterative Self-Prompting with LLMs
by: Ren, Libo, et al.
Published: (2025)
by: Ren, Libo, et al.
Published: (2025)
LaMPE: Length-aware Multi-grained Positional Encoding for Adaptive Long-context Scaling Without Training
by: Zhang, Sikui, et al.
Published: (2025)
by: Zhang, Sikui, et al.
Published: (2025)
Squeezed Attention: Accelerating Long Context Length LLM Inference
by: Hooper, Coleman, et al.
Published: (2024)
by: Hooper, Coleman, et al.
Published: (2024)
ParallelComp: Parallel Long-Context Compressor for Length Extrapolation
by: Xiong, Jing, et al.
Published: (2025)
by: Xiong, Jing, et al.
Published: (2025)
On Stable Long-Form Generation: Benchmarking and Mitigating Length Volatility
by: He, Zhitao, et al.
Published: (2026)
by: He, Zhitao, et al.
Published: (2026)
Multi-view Content-aware Indexing for Long Document Retrieval
by: Dong, Kuicai, et al.
Published: (2024)
by: Dong, Kuicai, et al.
Published: (2024)
Extracting Polymer Nanocomposite Samples from Full-Length Documents
by: Khalighinejad, Ghazal, et al.
Published: (2024)
by: Khalighinejad, Ghazal, et al.
Published: (2024)
Improving the Efficiency of Long Document Classification using Sentence Ranking Approach
by: Kokate, Prathamesh, et al.
Published: (2025)
by: Kokate, Prathamesh, et al.
Published: (2025)
Core Context Aware Transformers for Long Context Language Modeling
by: Chen, Yaofo, et al.
Published: (2024)
by: Chen, Yaofo, et al.
Published: (2024)
LongStory: Coherent, Complete and Length Controlled Long story Generation
by: Park, Kyeongman, et al.
Published: (2023)
by: Park, Kyeongman, et al.
Published: (2023)
Diffusion Language Models Are Natively Length-Aware
by: Rossi, Vittorio, et al.
Published: (2026)
by: Rossi, Vittorio, et al.
Published: (2026)
LongHealth: A Question Answering Benchmark with Long Clinical Documents
by: Adams, Lisa, et al.
Published: (2024)
by: Adams, Lisa, et al.
Published: (2024)
Time Matters: Examine Temporal Effects on Biomedical Language Models
by: Liu, Weisi, et al.
Published: (2024)
by: Liu, Weisi, et al.
Published: (2024)
Extrapolation by Association: Length Generalization Transfer in Transformers
by: Cai, Ziyang, et al.
Published: (2025)
by: Cai, Ziyang, et al.
Published: (2025)
Auxiliary Knowledge-Induced Learning for Automatic Multi-Label Medical Document Classification
by: Wang, Xindi, et al.
Published: (2024)
by: Wang, Xindi, et al.
Published: (2024)
MM-Doc-R1: Training Agents for Long Document Visual Question Answering through Multi-turn Reinforcement Learning
by: Lin, Jiahang, et al.
Published: (2026)
by: Lin, Jiahang, et al.
Published: (2026)
Similar Items
-
Examining and Adapting Time for Multilingual Classification via Mixture of Temporal Experts
by: Liu, Weisi, et al.
Published: (2025) -
What Makes Good Instruction-Tuning Data? An In-Context Learning Perspective
by: Han, Guangzeng, et al.
Published: (2026) -
Attributes as Textual Genes: Leveraging LLMs as Genetic Algorithm Simulators for Conditional Synthetic Data Generation
by: Han, Guangzeng, et al.
Published: (2025) -
Knowledge-driven Augmentation and Retrieval for Integrative Temporal Adaptation
by: Liu, Weisi, et al.
Published: (2026) -
Model-Agnostic Meta Learning for Class Imbalance Adaptation
by: Rao, Hanshu, et al.
Published: (2026)