Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | Peng, Bo, Goldstein, Daniel, Anthony, Quentin, Albalak, Alon, Alcaide, Eric, Biderman, Stella, Cheah, Eugene, Du, Xingjian, Ferdinan, Teddy, Hou, Haowen, Kazienko, Przemysław, GV, Kranthi Kiran, Kocoń, Jan, Koptyra, Bartłomiej, Krishna, Satyapriya, McClelland Jr., Ronald, Lin, Jiaju, Muennighoff, Niklas, Obeid, Fares, Saito, Atsushi, Song, Guangyu, Tu, Haoqin, Wirawan, Cahya, Woźniak, Stanisław, Zhang, Ruichong, Zhao, Bingchen, Zhao, Qihang, Zhou, Peng, Zhu, Jian, Zhu, Rui-Jie |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
Documents similaires
Into the Unknown: Self-Learning Large Language Models
par: Ferdinan, Teddy, et autres
Publié: (2024)
par: Ferdinan, Teddy, et autres
Publié: (2024)
GoldFinch: High Performance RWKV/Transformer Hybrid with Linear Pre-Fill and Extreme KV-Cache Compression
par: Goldstein, Daniel, et autres
Publié: (2024)
par: Goldstein, Daniel, et autres
Publié: (2024)
Personalized Large Language Models
par: Woźniak, Stanisław, et autres
Publié: (2024)
par: Woźniak, Stanisław, et autres
Publié: (2024)
Fortifying NLP models - dataset + code
par: Ferdinan, Teddy, et autres
Publié: (2025)
par: Ferdinan, Teddy, et autres
Publié: (2025)
AggTruth: Contextual Hallucination Detection using Aggregated Attention Scores in LLMs
par: Matys, Piotr, et autres
Publié: (2025)
par: Matys, Piotr, et autres
Publié: (2025)
What properties of reasoning supervision are associated with improved downstream model quality?
par: Langner, Mikołaj, et autres
Publié: (2026)
par: Langner, Mikołaj, et autres
Publié: (2026)
Agnosticism About Artificial Consciousness
par: McClelland, Tom
Publié: (2024)
par: McClelland, Tom
Publié: (2024)
Agnosticism about artificial consciousness
par: Tom McClelland
Publié: (2025)
par: Tom McClelland
Publié: (2025)
“Whether my Body Breaks or the Plum Tree Withers”: Iwanaga Maki, Social Welfare Pioneer, and the jūjikai Women's Religious Order
par: Gwyn McClelland
Publié: (2024)
par: Gwyn McClelland
Publié: (2024)
Leta Semadeni's Romansh‐German poetry: Poetic praxis between languages
par: Richard McClelland
Publié: (2025)
par: Richard McClelland
Publié: (2025)
Photoshop 6 para dummies / Deke McClelland ; revisado por Barbara Obermeier
par: McClelland, Deke
Publié: (2001)
par: McClelland, Deke
Publié: (2001)
The Natural
par: McClelland, Kate
Publié: (2005)
par: McClelland, Kate
Publié: (2005)
Roman Catholicism and the History of Christianity in Modern Japan
par: Gwyn McClelland
Publié: (2025)
par: Gwyn McClelland
Publié: (2025)
RWKV-7 "Goose" with Expressive Dynamic State Evolution
par: Peng, Bo, et autres
Publié: (2025)
par: Peng, Bo, et autres
Publié: (2025)
Self-training Large Language Models through Knowledge Detection
par: Yeo, Wei Jie, et autres
Publié: (2024)
par: Yeo, Wei Jie, et autres
Publié: (2024)
Beyond the Carnot limit: work extraction via an entropy battery
par: McClelland, Liam Judd
Publié: (2025)
par: McClelland, Liam Judd
Publié: (2025)
The Education of Women in the United States: A Guide to Theory, Teaching, and Research. Garland Reference Library of Social Science Volume 551. Source Books on Education Volume 23.
par: McClelland, Averil Evans
Publié: (1992)
par: McClelland, Averil Evans
Publié: (1992)
Trends and Issues in the 1993 Professional Education Literature.
par: McClelland, Susan, et autres
Publié: (1994)
par: McClelland, Susan, et autres
Publié: (1994)
Reflections on David E. Rumelhart and the Rumelhart Prize
par: James L. McClelland
Publié: (2025)
par: James L. McClelland
Publié: (2025)
Modeling Language as a Sequence of Thoughts
par: Borazjanizadeh, Nasim, et autres
Publié: (2025)
par: Borazjanizadeh, Nasim, et autres
Publié: (2025)
Seeing Others as Objects: Perceptual Objectification & Affordances
par: Paulina Sliwa, et autres
Publié: (2025)
par: Paulina Sliwa, et autres
Publié: (2025)
Young Critics with a Passion for Books.
par: Clark, Mary, et autres
Publié: (1997)
par: Clark, Mary, et autres
Publié: (1997)
Routes to Roots: Acquiring Genealogical and Local History Materials in a Large Canadian Public Library
par: McClelland, Arthur G. W.
Publié: (2004)
par: McClelland, Arthur G. W.
Publié: (2004)
Use of endoparasitic helminths as tags in delineating stocks of American plaice (Hippoglossoides platessoides) from the southern Gulf of St. Lawrence and Cape Breton Shelf
par: McClelland, Gary, et autres
Publié: (2007)
par: McClelland, Gary, et autres
Publié: (2007)
Neural Computation Without Slots: Steps Towards Biologically Plausible Memory and Attention in Natural and Artificial Intelligence
par: Bhandarkar, Shaunak, et autres
Publié: (2025)
par: Bhandarkar, Shaunak, et autres
Publié: (2025)
On General 2-dimensional Lattice Spectra: Closedness, Hall's Ray, and Examples
par: Zhang, Ruichong
Publié: (2024)
par: Zhang, Ruichong
Publié: (2024)
PointRWKV: Efficient RWKV-Like Model for Hierarchical Point Cloud Learning
par: He, Qingdong, et autres
Publié: (2024)
par: He, Qingdong, et autres
Publié: (2024)
Vision-RWKV: Efficient and Scalable Visual Perception with RWKV-Like Architectures
par: Duan, Yuchen, et autres
Publié: (2024)
par: Duan, Yuchen, et autres
Publié: (2024)
Scanning Thermal Microscopy in Air and Vacuum: A Comparison
par: McClelland, Jabez J., et autres
Publié: (2024)
par: McClelland, Jabez J., et autres
Publié: (2024)
The Overlooked Burden of Atypical Anorexia Nervosa: Commentary on Melville et al. (2025)
par: Susan M. Byrne, et autres
Publié: (2025)
par: Susan M. Byrne, et autres
Publié: (2025)
medical and sanitary significance" (May 4-6, 2019, Janowiec near Vistula River, Poland) XXI Międzynarodowe Sympozjum "Stawonogi pasożytnicze, alergogenne i jadowite - znaczenie medyczne i sanitarne" (4-6 maja 2019, Janowiec nad Wisłą, Polska)
par: Kocoń, Anna
Publié: (2019)
par: Kocoń, Anna
Publié: (2019)
Fig. 1 in "Vectors and pathogens in the past and the future" (November 24, 2017, Wroclaw, Poland) IV Międzynarodowa Konferencja "Wektory i patogeny w przeszłoŚci i przyszłoŚci" (24 listopad 2017, Wrocław, Polska)
par: Kocoń, Anna
Publié: (2018)
par: Kocoń, Anna
Publié: (2018)
Ensemble of Precision-Recall Curve (PRC) Classification Trees with Autoencoders
par: Miao, Jiaju, et autres
Publié: (2025)
par: Miao, Jiaju, et autres
Publié: (2025)
Towards Causality-Aware Modeling for Multimodal Brain-Muscle Interactions
par: Abbas, Farwa, et autres
Publié: (2026)
par: Abbas, Farwa, et autres
Publié: (2026)
Stationary and Sparse Denoising Approach for Corticomuscular Causality Estimation
par: Abbas, Farwa, et autres
Publié: (2024)
par: Abbas, Farwa, et autres
Publié: (2024)
Emergent Symbol-like Number Variables in Artificial Neural Networks
par: Grant, Satchel, et autres
Publié: (2025)
par: Grant, Satchel, et autres
Publié: (2025)
Matrix-Driven Identification and Reconstruction of LLM Weight Homology
par: Zhang, Ruichong, et autres
Publié: (2025)
par: Zhang, Ruichong, et autres
Publié: (2025)
Video RWKV:Video Action Recognition Based RWKV
par: Yin, Zhuowen, et autres
Publié: (2024)
par: Yin, Zhuowen, et autres
Publié: (2024)
Hour‐Long Afterglow in Flexible Polymeric Materials through the Introduction of Electron Donor/Acceptor Exciplexes
par: Jiaju Shi, et autres
Publié: (2025)
par: Jiaju Shi, et autres
Publié: (2025)
UNIVERSITY LIFE, SMOKING, AND STRESS: BEHAVIORAL PATTERNS AMONG STUDENTS IN BALI
par: Aditya, Putra Wirawan
Publié: (2025)
par: Aditya, Putra Wirawan
Publié: (2025)
Documents similaires
-
Into the Unknown: Self-Learning Large Language Models
par: Ferdinan, Teddy, et autres
Publié: (2024) -
GoldFinch: High Performance RWKV/Transformer Hybrid with Linear Pre-Fill and Extreme KV-Cache Compression
par: Goldstein, Daniel, et autres
Publié: (2024) -
Personalized Large Language Models
par: Woźniak, Stanisław, et autres
Publié: (2024) -
Fortifying NLP models - dataset + code
par: Ferdinan, Teddy, et autres
Publié: (2025) -
AggTruth: Contextual Hallucination Detection using Aggregated Attention Scores in LLMs
par: Matys, Piotr, et autres
Publié: (2025)