Cover Image

A Survey of RWKV

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Li, Zhiyuan, Xia, Tingyu, Chang, Yi, Wu, Yuan
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Language Models can Evaluate Themselves via Probability Discrepancy
by: Xia, Tingyu, et al.
Published: (2024)

Rethinking Data Selection at Scale: Random Selection is Almost All You Need
by: Xia, Tingyu, et al.
Published: (2024)

ModRWKV: Transformer Multimodality in Linear Time
by: Kang, Jiale, et al.
Published: (2025)

The Evolution of RWKV: Advancements in Efficient Language Modeling
by: Datta, Akul
Published: (2024)

RRWKV: Capturing Long-range Dependencies in RWKV
by: Wang, Leilei
Published: (2023)

Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence
by: Peng, Bo, et al.
Published: (2024)

Enhancing RWKV-based Language Models for Long-Sequence Text Generation
by: Pan, Xinghan
Published: (2025)

A Survey on Evaluation of Large Language Models
by: Chang, Yupeng, et al.
Published: (2023)

A Survey on In-context Learning
by: Dong, Qingxiu, et al.
Published: (2022)

VisualRWKV-HD and UHD: Advancing High-Resolution Processing for Visual Language Models
by: Li, Zihang, et al.
Published: (2024)

GoldFinch: High Performance RWKV/Transformer Hybrid with Linear Pre-Fill and Extreme KV-Cache Compression
by: Goldstein, Daniel, et al.
Published: (2024)

Efficiency-Effectiveness Reranking FLOPs for LLM-based Rerankers
by: Peng, Zhiyuan, et al.
Published: (2025)

DeepSurvey-Bench: Evaluating Academic Value of Automatically Generated Scientific Survey
by: Zhang, Guo-Biao, et al.
Published: (2026)

Co-EPG: A Framework for Co-Evolution of Planning and Grounding in Autonomous GUI Agents
by: Zhao, Yuan, et al.
Published: (2025)

Self-play with Execution Feedback: Improving Instruction-following Capabilities of Large Language Models
by: Dong, Guanting, et al.
Published: (2024)

Align, Don't Divide: Revisiting the LoRA Architecture in Multi-Task Learning
by: Liu, Jinda, et al.
Published: (2025)

L3TC: Leveraging RWKV for Learned Lossless Low-Complexity Text Compression
by: Zhang, Junxuan, et al.
Published: (2024)

A Survey on Feedback-based Multi-step Reasoning for Large Language Models on Mathematics
by: Wei, Ting-Ruen, et al.
Published: (2025)

A Survey on Human-Centric LLMs
by: Wang, Jing Yi, et al.
Published: (2024)

Beyond Chain-of-Thought: A Survey of Chain-of-X Paradigms for LLMs
by: Xia, Yu, et al.
Published: (2024)

Large Language Model Evaluation via Matrix Nuclear-Norm
by: Li, Yahan, et al.
Published: (2024)

Length-Controlled Margin-Based Preference Optimization without Reference Model
by: Li, Gengxu, et al.
Published: (2025)

Metaphors We Compute By: A Computational Audit of Cultural Translation vs. Thinking in LLMs
by: Chang, Yuan, et al.
Published: (2026)

A Survey on Large Language Models for Mathematical Reasoning
by: Wang, Peng-Yuan, et al.
Published: (2025)

Search and Refine During Think: Facilitating Knowledge Refinement for Improved Retrieval-Augmented Reasoning
by: Shi, Yaorui, et al.
Published: (2025)

A Survey on LLM-Generated Text Detection: Necessity, Methods, and Future Directions
by: Wu, Junchao, et al.
Published: (2023)

A Survey of Neural Code Intelligence: Paradigms, Advances and Beyond
by: Sun, Qiushi, et al.
Published: (2024)

Interdisciplinary Fairness in Imbalanced Research Proposal Topic Inference: A Hierarchical Transformer-based Method with Selective Interpolation
by: Xiao, Meng, et al.
Published: (2023)

RWKV-7 "Goose" with Expressive Dynamic State Evolution
by: Peng, Bo, et al.
Published: (2025)

Retrieval Augmented Generation (RAG) and Beyond: A Comprehensive Survey on How to Make your LLMs use External Data More Wisely
by: Zhao, Siyun, et al.
Published: (2024)

Large Language Models Meet NLP: A Survey
by: Qin, Libo, et al.
Published: (2024)

A Survey of Retentive Network
by: Yang, Haiqi, et al.
Published: (2025)

ResearchQA: Evaluating Scholarly Question Answering at Scale Across 75 Fields with Survey-Mined Questions and Rubrics
by: Yifei, Li S., et al.
Published: (2025)

A Survey of Automatic Hallucination Evaluation on Natural Language Generation
by: Qi, Siya, et al.
Published: (2024)

PlanGenLLMs: A Modern Survey of LLM Planning Capabilities
by: Wei, Hui, et al.
Published: (2025)

A Survey for Large Language Models in Biomedicine
by: Wang, Chong, et al.
Published: (2024)

A Survey on Temporal Knowledge Graph: Representation Learning and Applications
by: Cai, Li, et al.
Published: (2024)

A Survey on Large Language Model based Autonomous Agents
by: Wang, Lei, et al.
Published: (2023)

A Survey on Self-Evolution of Large Language Models
by: Tao, Zhengwei, et al.
Published: (2024)

A Survey on the Honesty of Large Language Models
by: Li, Siheng, et al.
Published: (2024)