Benchmarking Recommendation, Classification, and Tracing Based on Hugging Face Knowledge Graph
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866910964270497792 |
|---|---|
| author | Chen, Qiaosheng Huang, Kaijia Zhou, Xiao Luo, Weiqing Cui, Yuanning Cheng, Gong |
| author_facet | Chen, Qiaosheng Huang, Kaijia Zhou, Xiao Luo, Weiqing Cui, Yuanning Cheng, Gong |
| contents | The rapid growth of open source machine learning (ML) resources, such as models and datasets, has accelerated IR research. However, existing platforms like Hugging Face do not explicitly utilize structured representations, limiting advanced queries and analyses such as tracing model evolution and recommending relevant datasets. To fill the gap, we construct HuggingKG, the first large-scale knowledge graph built from the Hugging Face community for ML resource management. With 2.6 million nodes and 6.2 million edges, HuggingKG captures domain-specific relations and rich textual attributes. It enables us to further present HuggingBench, a multi-task benchmark with three novel test collections for IR tasks including resource recommendation, classification, and tracing. Our experiments reveal unique characteristics of HuggingKG and the derived tasks. Both resources are publicly available, expected to advance research in open source resource sharing and management. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_17507 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Benchmarking Recommendation, Classification, and Tracing Based on Hugging Face Knowledge Graph Chen, Qiaosheng Huang, Kaijia Zhou, Xiao Luo, Weiqing Cui, Yuanning Cheng, Gong Information Retrieval The rapid growth of open source machine learning (ML) resources, such as models and datasets, has accelerated IR research. However, existing platforms like Hugging Face do not explicitly utilize structured representations, limiting advanced queries and analyses such as tracing model evolution and recommending relevant datasets. To fill the gap, we construct HuggingKG, the first large-scale knowledge graph built from the Hugging Face community for ML resource management. With 2.6 million nodes and 6.2 million edges, HuggingKG captures domain-specific relations and rich textual attributes. It enables us to further present HuggingBench, a multi-task benchmark with three novel test collections for IR tasks including resource recommendation, classification, and tracing. Our experiments reveal unique characteristics of HuggingKG and the derived tasks. Both resources are publicly available, expected to advance research in open source resource sharing and management. |
| title | Benchmarking Recommendation, Classification, and Tracing Based on Hugging Face Knowledge Graph |
| topic | Information Retrieval |
| url | https://arxiv.org/abs/2505.17507 |