Cover Image

Transformers and Cortical Waves: Encoders for Pulling In Context Across Time

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Muller, Lyle, Churchland, Patricia S., Sejnowski, Terrence J.
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Dynamical Mechanisms for Coordinating Long-term Working Memory Based on the Precision of Spike-timing in Cortical Neurons
by: Sejnowski, Terrence J.
Published: (2025)

Traveling Waves Encode the Recent Past and Enhance Sequence Learning
by: Keller, T. Anderson, et al.
Published: (2023)

"Pull or Not to Pull?'': Investigating Moral Biases in Leading Large Language Models Across Ethical Dilemmas
by: Ding, Junchen, et al.
Published: (2025)

RexBERT: Context Specialized Bidirectional Encoders for E-commerce
by: Bajaj, Rahul, et al.
Published: (2026)

Assessing Logical Reasoning Capabilities of Encoder-Only Transformer Models
by: Pirozelli, Paulo, et al.
Published: (2023)

When and Where Did it Happen? An Encoder-Decoder Model to Identify Scenario Context
by: Noriega-Atala, Enrique, et al.
Published: (2024)

AraModernBERT: Transtokenized Initialization and Long-Context Encoder Modeling for Arabic
by: Elshehy, Omar, et al.
Published: (2026)

Fine-tuning Transformer-based Encoder for Turkish Language Understanding Tasks
by: Yildirim, Savas
Published: (2024)

Shaping Explanations: Semantic Reward Modeling with Encoder-Only Transformers for GRPO
by: Pappone, Francesco, et al.
Published: (2025)

Transformer-Encoder Trees for Efficient Multilingual Machine Translation and Speech Translation
by: Guan, Yiwen, et al.
Published: (2025)

BioClinical ModernBERT: A State-of-the-Art Long-Context Encoder for Biomedical and Clinical NLP
by: Sounack, Thomas, et al.
Published: (2025)

Optimizing Attention and Cognitive Control Costs Using Temporally-Layered Architectures
by: Patel, Devdhar, et al.
Published: (2023)

Quasi-symbolic Semantic Geometry over Transformer-based Variational AutoEncoder
by: Zhang, Yingji, et al.
Published: (2022)

Multi-Task Pre-Finetuning of Lightweight Transformer Encoders for Text Classification and NER
by: Zhu, Junyi, et al.
Published: (2025)

Personality Expression Across Contexts: Linguistic and Behavioral Variation in LLM Agents
by: Han, Bin, et al.
Published: (2026)

Layer-Wise Evolution of Representations in Fine-Tuned Transformers: Insights from Sparse AutoEncoders
by: Nadipalli, Suneel
Published: (2025)

LabelFusion: Fusing Large Language Models with Transformer Encoders for Robust Financial News Classification
by: Schlee, Michael, et al.
Published: (2025)

Emergence and Effectiveness of Task Vectors in In-Context Learning: An Encoder Decoder Perspective
by: Han, Seungwook, et al.
Published: (2024)

RAVEN: In-Context Learning with Retrieval-Augmented Encoder-Decoder Language Models
by: Huang, Jie, et al.
Published: (2023)

SEED: A Structural Encoder for Embedding-Driven Decoding in Time Series Prediction with LLMs
by: Li, Fengze, et al.
Published: (2025)

Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference
by: Warner, Benjamin, et al.
Published: (2024)

ViRanker: A BGE-M3 & Blockwise Parallel Transformer Cross-Encoder for Vietnamese Reranking
by: Dang, Phuong-Nam, et al.
Published: (2025)

Fuzzy Fingerprinting Encoder Pre-trained Language Models for Emotion Recognition in Conversations: Human Assessment and Validity Study
by: Pereira, Patrícia, et al.
Published: (2026)

NeuroAI and Beyond
by: Fellous, Jean-Marc, et al.
Published: (2026)

Transformers in the Service of Description Logic-based Contexts
by: Poulis, Angelos, et al.
Published: (2023)

Time Awareness in Large Language Models: Benchmarking Fact Recall Across Time
by: Herel, David, et al.
Published: (2024)

Beyond One World: Benchmarking Super Heros in Role-Playing Across Multiversal Contexts
by: Ngokpol, Perapard, et al.
Published: (2025)

Decoders Laugh as Loud as Encoders
by: Borodach, Eli, et al.
Published: (2025)

The Strong Pull of Prior Knowledge in Large Language Models and Its Impact on Emotion Recognition
by: Chochlakis, Georgios, et al.
Published: (2024)

Large Language Models as symbolic DNA of cultural dynamics
by: Pourdavood, Parham, et al.
Published: (2025)

Comparative Analysis of 47 Context-Based Question Answer Models Across 8 Diverse Datasets
by: Muneeb, Muhammad, et al.
Published: (2025)

A Survey on Transformer Context Extension: Approaches and Evaluation
by: Liu, Yijun, et al.
Published: (2025)

Feature-Augmented Transformers for Robust AI-Text Detection Across Domains and Generators
by: Mady, Mohamed, et al.
Published: (2026)

SQL-Exchange: Transforming SQL Queries Across Domains
by: Daviran, Mohammadreza, et al.
Published: (2025)

Context Steering: Controllable Personalization at Inference Time
by: He, Jerry Zhi-Yang, et al.
Published: (2024)

On the Transformations across Reward Model, Parameter Update, and In-Context Prompt
by: Cai, Deng, et al.
Published: (2024)

Gradual Forgetting: Logarithmic Compression for Extending Transformer Context Windows
by: Dickson, Billy, et al.
Published: (2025)

ChatLog: Carefully Evaluating the Evolution of ChatGPT Across Time
by: Tu, Shangqing, et al.
Published: (2023)

Efficient Text Encoders for Labor Market Analysis
by: Decorte, Jens-Joris, et al.
Published: (2025)

ATLAS: Learning to Optimally Memorize the Context at Test Time
by: Behrouz, Ali, et al.
Published: (2025)