Chain-of-Rank: Enhancing Large Language Models for Domain-Specific RAG in Edge Device

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Lee, Juntae, Bang, Jihwan, Yang, Seunghan, Shim, Kyuhong, Chang, Simyung
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912240001613824
author Lee, Juntae
Bang, Jihwan
Yang, Seunghan
Shim, Kyuhong
Chang, Simyung
author_facet Lee, Juntae
Bang, Jihwan
Yang, Seunghan
Shim, Kyuhong
Chang, Simyung
contents Retrieval-augmented generation (RAG) with large language models (LLMs) is especially valuable in specialized domains, where precision is critical. To more specialize the LLMs into a target domain, domain-specific RAG has recently been developed by allowing the LLM to access the target domain early via finetuning. The domain-specific RAG makes more sense in resource-constrained environments like edge devices, as they should perform a specific task (e.g. personalization) reliably using only small-scale LLMs. While the domain-specific RAG is well-aligned with edge devices in this respect, it often relies on widely-used reasoning techniques like chain-of-thought (CoT). The reasoning step is useful to understand the given external knowledge, and yet it is computationally expensive and difficult for small-scale LLMs to learn it. Tackling this, we propose the Chain of Rank (CoR) which shifts the focus from intricate lengthy reasoning to simple ranking of the reliability of input external documents. Then, CoR reduces computational complexity while maintaining high accuracy, making it particularly suited for resource-constrained environments. We attain the state-of-the-art (SOTA) results in benchmarks, and analyze its efficacy.
format Preprint
id arxiv_https___arxiv_org_abs_2502_15134
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Chain-of-Rank: Enhancing Large Language Models for Domain-Specific RAG in Edge Device
Lee, Juntae
Bang, Jihwan
Yang, Seunghan
Shim, Kyuhong
Chang, Simyung
Computation and Language
Artificial Intelligence
Retrieval-augmented generation (RAG) with large language models (LLMs) is especially valuable in specialized domains, where precision is critical. To more specialize the LLMs into a target domain, domain-specific RAG has recently been developed by allowing the LLM to access the target domain early via finetuning. The domain-specific RAG makes more sense in resource-constrained environments like edge devices, as they should perform a specific task (e.g. personalization) reliably using only small-scale LLMs. While the domain-specific RAG is well-aligned with edge devices in this respect, it often relies on widely-used reasoning techniques like chain-of-thought (CoT). The reasoning step is useful to understand the given external knowledge, and yet it is computationally expensive and difficult for small-scale LLMs to learn it. Tackling this, we propose the Chain of Rank (CoR) which shifts the focus from intricate lengthy reasoning to simple ranking of the reliability of input external documents. Then, CoR reduces computational complexity while maintaining high accuracy, making it particularly suited for resource-constrained environments. We attain the state-of-the-art (SOTA) results in benchmarks, and analyze its efficacy.
title Chain-of-Rank: Enhancing Large Language Models for Domain-Specific RAG in Edge Device
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2502.15134