An Empirical Study of Multi-Agent RAG for Real-World University Admissions Counseling
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913942716022784 |
|---|---|
| author | Nguyen-Duc, Anh Manh, Chien Vu Tran, Bao Anh Ngo, Viet Phuong Chi, Luan Le Nguyen, Anh Quang |
| author_facet | Nguyen-Duc, Anh Manh, Chien Vu Tran, Bao Anh Ngo, Viet Phuong Chi, Luan Le Nguyen, Anh Quang |
| contents | This paper presents MARAUS (Multi-Agent and Retrieval-Augmented University Admission System), a real-world deployment of a conversational AI platform for higher education admissions counseling in Vietnam. While large language models (LLMs) offer potential for automating advisory tasks, most existing solutions remain limited to prototypes or synthetic benchmarks. MARAUS addresses this gap by combining hybrid retrieval, multi-agent orchestration, and LLM-based generation into a system tailored for real-world university admissions. In collaboration with the University of Transport Technology (UTT) in Hanoi, we conducted a two-phase study involving technical development and real-world evaluation. MARAUS processed over 6,000 actual user interactions, spanning six categories of queries. Results show substantial improvements over LLM-only baselines: on average 92 percent accuracy, hallucination rates reduced from 15 precent to 1.45 percent, and average response times below 4 seconds. The system operated cost-effectively, with a two-week deployment cost of 11.58 USD using GPT-4o mini. This work provides actionable insights for the deployment of agentic RAG systems in low-resource educational settings. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_11272 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | An Empirical Study of Multi-Agent RAG for Real-World University Admissions Counseling Nguyen-Duc, Anh Manh, Chien Vu Tran, Bao Anh Ngo, Viet Phuong Chi, Luan Le Nguyen, Anh Quang Software Engineering Information Retrieval This paper presents MARAUS (Multi-Agent and Retrieval-Augmented University Admission System), a real-world deployment of a conversational AI platform for higher education admissions counseling in Vietnam. While large language models (LLMs) offer potential for automating advisory tasks, most existing solutions remain limited to prototypes or synthetic benchmarks. MARAUS addresses this gap by combining hybrid retrieval, multi-agent orchestration, and LLM-based generation into a system tailored for real-world university admissions. In collaboration with the University of Transport Technology (UTT) in Hanoi, we conducted a two-phase study involving technical development and real-world evaluation. MARAUS processed over 6,000 actual user interactions, spanning six categories of queries. Results show substantial improvements over LLM-only baselines: on average 92 percent accuracy, hallucination rates reduced from 15 precent to 1.45 percent, and average response times below 4 seconds. The system operated cost-effectively, with a two-week deployment cost of 11.58 USD using GPT-4o mini. This work provides actionable insights for the deployment of agentic RAG systems in low-resource educational settings. |
| title | An Empirical Study of Multi-Agent RAG for Real-World University Admissions Counseling |
| topic | Software Engineering Information Retrieval |
| url | https://arxiv.org/abs/2507.11272 |