Cover Image

RRWKV: Capturing Long-range Dependencies in RWKV

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Wang, Leilei
Format:	Preprint
Published:	2023
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Survey of RWKV
by: Li, Zhiyuan, et al.
Published: (2024)

Enhancing RWKV-based Language Models for Long-Sequence Text Generation
by: Pan, Xinghan
Published: (2025)

ModRWKV: Transformer Multimodality in Linear Time
by: Kang, Jiale, et al.
Published: (2025)

The Evolution of RWKV: Advancements in Efficient Language Modeling
by: Datta, Akul
Published: (2024)

Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence
by: Peng, Bo, et al.
Published: (2024)

GoldFinch: High Performance RWKV/Transformer Hybrid with Linear Pre-Fill and Extreme KV-Cache Compression
by: Goldstein, Daniel, et al.
Published: (2024)

L3TC: Leveraging RWKV for Learned Lossless Low-Complexity Text Compression
by: Zhang, Junxuan, et al.
Published: (2024)

VisualRWKV-HD and UHD: Advancing High-Resolution Processing for Visual Language Models
by: Li, Zihang, et al.
Published: (2024)

OWL: Overcoming Window Length-Dependence in Speculative Decoding for Long-Context Inputs
by: Lee, Jaeseong, et al.
Published: (2025)

Harnessing Large Language Models for Biomedical Named Entity Recognition
by: Chen, Jian, et al.
Published: (2025)

LooGLE v2: Are LLMs Ready for Real World Long Dependency Challenges?
by: He, Ziyuan, et al.
Published: (2025)

SQLCritic: Correcting Text-to-SQL Generation via Clause-wise Critic
by: Chen, Jikai, et al.
Published: (2025)

Capturing Bias Diversity in LLMs
by: Gosavi, Purva Prasad, et al.
Published: (2024)

DepthKV: Layer-Dependent KV Cache Pruning for Long-Context LLM Inference
by: Dehghanighobadi, Zahra, et al.
Published: (2026)

Neurocache: Efficient Vector Retrieval for Long-range Language Modeling
by: Safaya, Ali, et al.
Published: (2024)

FaithfulSAE: Towards Capturing Faithful Features with Sparse Autoencoders without External Dataset Dependencies
by: Cho, Seonglae, et al.
Published: (2025)

Fast-Slow Thinking GRPO for Large Vision-Language Model Reasoning
by: Xiao, Wenyi, et al.
Published: (2025)

Can LLMs Capture Human Preferences?
by: Goli, Ali, et al.
Published: (2023)

HoPE: Hyperbolic Rotary Positional Encoding for Stable Long-Range Dependency Modeling in Large Language Models
by: Dai, Chang, et al.
Published: (2025)

Beyond the Binary: Capturing Diverse Preferences With Reward Regularization
by: Padmakumar, Vishakh, et al.
Published: (2024)

Do LLMs Capture Embodied Cognition and Cultural Variation? Cross-Linguistic Evidence from Demonstratives
by: Wang, Yu, et al.
Published: (2026)

RWKV-7 "Goose" with Expressive Dynamic State Evolution
by: Peng, Bo, et al.
Published: (2025)

InMind: Evaluating LLMs in Capturing and Applying Individual Human Reasoning Styles
by: Li, Zizhen, et al.
Published: (2025)

CHRONOBERG: Capturing Language Evolution and Temporal Awareness in Foundation Models
by: Hegde, Niharika, et al.
Published: (2025)

Psychometric Alignment: Capturing Human Knowledge Distributions via Language Models
by: He-Yueya, Joy, et al.
Published: (2024)

Capturing Nuanced Preferences: Preference-Aligned Distillation for Small Language Models
by: Gu, Yanggan, et al.
Published: (2025)

Capturing Pertinent Symbolic Features for Enhanced Content-Based Misinformation Detection
by: Merenda, Flavio, et al.
Published: (2024)

When Abel Kills Cain: What Machine Translation Cannot Capture
by: Bénel, Aurélien, et al.
Published: (2024)

VL-Calibration: Decoupled Confidence Calibration for Large Vision-Language Models Reasoning
by: Xiao, Wenyi, et al.
Published: (2026)

Exploring RWKV for Sentence Embeddings: Layer-wise Analysis and Baseline Comparison for Semantic Similarity
by: Pan, Xinghan
Published: (2025)

Dependency Transformer Grammars: Integrating Dependency Structures into Transformer Language Models
by: Zhao, Yida, et al.
Published: (2024)

Alleviating Choice Supportive Bias in LLM with Reasoning Dependency Generation
by: Zhuang, Nan, et al.
Published: (2025)

RePST: Language Model Empowered Spatio-Temporal Forecasting via Semantic-Oriented Reprogramming
by: Wang, Hao, et al.
Published: (2024)

LongSafety: Evaluating Long-Context Safety of Large Language Models
by: Lu, Yida, et al.
Published: (2025)

Don't Half-listen: Capturing Key-part Information in Continual Instruction Tuning
by: He, Yongquan, et al.
Published: (2024)

A Tale of Two Structures: Do LLMs Capture the Fractal Complexity of Language?
by: Alabdulmohsin, Ibrahim, et al.
Published: (2025)

Can Reasoning Help Large Language Models Capture Human Annotator Disagreement?
by: Ni, Jingwei, et al.
Published: (2025)

LooGLE: Can Long-Context Language Models Understand Long Contexts?
by: Li, Jiaqi, et al.
Published: (2023)

VIDA: A dataset for Visually Dependent Ambiguity in Multimodal Machine Translation
by: Pan, Jingheng, et al.
Published: (2026)

Negation Triplet Extraction with Syntactic Dependency and Semantic Consistency
by: Shi, Yuchen, et al.
Published: (2024)