Darkit: A User-Friendly Software Toolkit for Spiking Large Language Model
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866917875487342592 |
|---|---|
| author | Du, Xin Ye, Shifan Zheng, Qian Hu, Yangfan Yan, Rui Qi, Shunyu Chen, Shuyang Tang, Huajin Pan, Gang Deng, Shuiguang |
| author_facet | Du, Xin Ye, Shifan Zheng, Qian Hu, Yangfan Yan, Rui Qi, Shunyu Chen, Shuyang Tang, Huajin Pan, Gang Deng, Shuiguang |
| contents | Large language models (LLMs) have been widely applied in various practical applications, typically comprising billions of parameters, with inference processes requiring substantial energy and computational resources. In contrast, the human brain, employing bio-plausible spiking mechanisms, can accomplish the same tasks while significantly reducing energy consumption, even with a similar number of parameters. Based on this, several pioneering researchers have proposed and implemented various large language models that leverage spiking neural networks. They have demonstrated the feasibility of these models, validated their performance, and open-sourced their frameworks and partial source code. To accelerate the adoption of brain-inspired large language models and facilitate secondary development for researchers, we are releasing a software toolkit named DarwinKit (Darkit). The toolkit is designed specifically for learners, researchers, and developers working on spiking large models, offering a suite of highly user-friendly features that greatly simplify the learning, deployment, and development processes. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_15634 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Darkit: A User-Friendly Software Toolkit for Spiking Large Language Model Du, Xin Ye, Shifan Zheng, Qian Hu, Yangfan Yan, Rui Qi, Shunyu Chen, Shuyang Tang, Huajin Pan, Gang Deng, Shuiguang Software Engineering Large language models (LLMs) have been widely applied in various practical applications, typically comprising billions of parameters, with inference processes requiring substantial energy and computational resources. In contrast, the human brain, employing bio-plausible spiking mechanisms, can accomplish the same tasks while significantly reducing energy consumption, even with a similar number of parameters. Based on this, several pioneering researchers have proposed and implemented various large language models that leverage spiking neural networks. They have demonstrated the feasibility of these models, validated their performance, and open-sourced their frameworks and partial source code. To accelerate the adoption of brain-inspired large language models and facilitate secondary development for researchers, we are releasing a software toolkit named DarwinKit (Darkit). The toolkit is designed specifically for learners, researchers, and developers working on spiking large models, offering a suite of highly user-friendly features that greatly simplify the learning, deployment, and development processes. |
| title | Darkit: A User-Friendly Software Toolkit for Spiking Large Language Model |
| topic | Software Engineering |
| url | https://arxiv.org/abs/2412.15634 |