Cover Image

Extending Llama-3's Context Ten-Fold Overnight

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Peitian, Shao, Ninglu, Liu, Zheng, Xiao, Shitao, Qian, Hongjin, Ye, Qiwei, Dou, Zhicheng
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Compressing Lengthy Context With UltraGist
by: Zhang, Peitian, et al.
Published: (2024)

Long Context Compression with Activation Beacon
by: Zhang, Peitian, et al.
Published: (2024)

Extensible Embedding: A Flexible Multipler For LLM's Context Length
by: Shao, Ninglu, et al.
Published: (2024)

Flexibly Scaling Large Language Models Contexts Through Extensible Tokenization
by: Shao, Ninglu, et al.
Published: (2024)

Boosting Long-Context Management via Query-Guided Activation Refilling
by: Qian, Hongjin, et al.
Published: (2024)

Are Long-LLMs A Necessity For Long-Context Tasks?
by: Qian, Hongjin, et al.
Published: (2024)

MemoRAG: Boosting Long Context Processing with Global Memory-Enhanced Retrieval Augmentation
by: Qian, Hongjin, et al.
Published: (2024)

Lighter And Better: Towards Flexible Context Adaptation For Retrieval Augmented Generation
by: Liu, Zheng, et al.
Published: (2024)

Does RAG Really Perform Bad For Long-Context Processing?
by: Luo, Kun, et al.
Published: (2025)

Llama2Vec: Unsupervised Adaptation of Large Language Models for Dense Retrieval
by: Liu, Zheng, et al.
Published: (2023)

Grounding Language Model with Chunking-Free In-Context Retrieval
by: Qian, Hongjin, et al.
Published: (2024)

M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillation
by: Chen, Jianlv, et al.
Published: (2024)

C-Pack: Packed Resources For General Chinese Embeddings
by: Xiao, Shitao, et al.
Published: (2023)

Single LLM, Multiple Roles: A Unified Retrieval-Augmented Generation Framework Using Role-Specific Token Optimization
by: Zhu, Yutao, et al.
Published: (2025)

HawkBench: Investigating Resilience of RAG Methods on Stratified Information-Seeking Tasks
by: Qian, Hongjin, et al.
Published: (2025)

A Multi-Task Embedder For Retrieval Augmented LLMs
by: Zhang, Peitian, et al.
Published: (2023)

SGNet: Folding Symmetrical Protein Complex with Deep Learning
by: Li, Zhaoqun, et al.
Published: (2024)

BGE Landmark Embedding: A Chunking-Free Embedding Method For Retrieval Augmented Long-Context Large Language Models
by: Luo, Kun, et al.
Published: (2024)

INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning
by: Zhu, Yutao, et al.
Published: (2024)

Scent of Knowledge: Optimizing Search-Enhanced Reasoning with Information Foraging
by: Qian, Hongjin, et al.
Published: (2025)

InfoFlow: Reinforcing Search Agent Via Reward Density Optimization
by: Luo, Kun, et al.
Published: (2025)

FinSight: Towards Real-World Financial Deep Research
by: Jin, Jiajie, et al.
Published: (2025)

AgentFugue: Agent Scaling for Long-Horizon Tasks through Collective Reasoning
by: Hu, Yuyang, et al.
Published: (2026)

Does Overnight News Explain Overnight Returns?
by: Glasserman, Paul, et al.
Published: (2025)

MetaAgent: Toward Self-Evolving Agent via Tool Meta-Learning
by: Qian, Hongjin, et al.
Published: (2025)

Model-Document Protocol for AI Search
by: Qian, Hongjin, et al.
Published: (2025)

From Matching to Generation: A Survey on Generative Information Retrieval
by: Li, Xiaoxi, et al.
Published: (2024)

VideoExplorer: Think With Videos For Agentic Long-Video Understanding
by: Yuan, Huaying, et al.
Published: (2025)

Search-o1: Agentic Search-Enhanced Large Reasoning Models
by: Li, Xiaoxi, et al.
Published: (2025)

LiveLongBench: Tackling Long-Context Understanding for Spoken Texts from Live Streams
by: Wu, Yongxuan, et al.
Published: (2025)

Matryoshka Re-Ranker: A Flexible Re-Ranking Architecture With Configurable Depth and Width
by: Liu, Zheng, et al.
Published: (2025)

P3: Prompts Promote Prompting
by: Zhang, Xinyu, et al.
Published: (2025)

MemoBrain: Executive Memory as an Agentic Brain for Reasoning
by: Qian, Hongjin, et al.
Published: (2026)

Understanding Privacy Risks of Embeddings Induced by Large Language Models
by: Zhu, Zhihao, et al.
Published: (2024)

MGH Radiology Llama: A Llama 3 70B Model for Radiology
by: Shi, Yucheng, et al.
Published: (2024)

HiRA: A Hierarchical Reasoning Framework for Decoupled Planning and Execution in Deep Search
by: Jin, Jiajie, et al.
Published: (2025)

U-Fold: Dynamic Intent-Aware Context Folding for User-Centric Agents
by: Su, Jin, et al.
Published: (2026)

AssistRAG: Boosting the Potential of Large Language Models with an Intelligent Information Assistant
by: Zhou, Yujia, et al.
Published: (2024)

Extending LLMs to New Languages: A Case Study of Llama and Persian Adaptation
by: Sani, Samin Mahdizadeh, et al.
Published: (2024)

Open Data Synthesis For Deep Research
by: Xia, Ziyi, et al.
Published: (2025)