Lian, H., Xiong, Y., Lin, Z., Niu, J., Mo, S., Chen, H., . . . Ding, G. (2024). LBPE: Long-token-first Tokenization to Improve Large Language Models.
Chicago Style (17th ed.) CitationLian, Haoran, Yizhe Xiong, Zijia Lin, Jianwei Niu, Shasha Mo, Hui Chen, Peng Liu, and Guiguang Ding. LBPE: Long-token-first Tokenization to Improve Large Language Models. 2024.
MLA (9th ed.) CitationLian, Haoran, et al. LBPE: Long-token-first Tokenization to Improve Large Language Models. 2024.
Warning: These citations may not always be 100% accurate.