Conscious Data Contribution via Community-Driven Chain-of-Thought Distillation
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866911329041776640 |
|---|---|
| author | Libon, Lena Bhange, Meghana Solanki, Rushabh Creager, Elliot Aïvodji, Ulrich |
| author_facet | Libon, Lena Bhange, Meghana Solanki, Rushabh Creager, Elliot Aïvodji, Ulrich |
| contents | The current era of AI development places a heavy emphasis on training large models on increasingly scaled-up datasets. This paradigm has catalyzed entirely new product categories, such as LLM chatbots, while also raising concerns about data privacy and consumer choice. In this paper, we consider questions of data portability and user autonomy in the context of LLMs that "reason" using chain-of-thought (CoT) traces, computing intermediate text artifacts from user input before producing a final output. We first interpret recent data privacy and portability law to argue that these intermediate computations qualify as users' personal data. Then, building on the existing framework of Conscious Data Contribution, we show how communities who receive low utility from an available model can aggregate and distill their shared knowledge into an alternate model better aligned with their goals. We verify this approach empirically and investigate the effects of community diversity, reasoning granularity, and community size on distillation performance. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_18174 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Conscious Data Contribution via Community-Driven Chain-of-Thought Distillation Libon, Lena Bhange, Meghana Solanki, Rushabh Creager, Elliot Aïvodji, Ulrich Machine Learning Cryptography and Security Computers and Society The current era of AI development places a heavy emphasis on training large models on increasingly scaled-up datasets. This paradigm has catalyzed entirely new product categories, such as LLM chatbots, while also raising concerns about data privacy and consumer choice. In this paper, we consider questions of data portability and user autonomy in the context of LLMs that "reason" using chain-of-thought (CoT) traces, computing intermediate text artifacts from user input before producing a final output. We first interpret recent data privacy and portability law to argue that these intermediate computations qualify as users' personal data. Then, building on the existing framework of Conscious Data Contribution, we show how communities who receive low utility from an available model can aggregate and distill their shared knowledge into an alternate model better aligned with their goals. We verify this approach empirically and investigate the effects of community diversity, reasoning granularity, and community size on distillation performance. |
| title | Conscious Data Contribution via Community-Driven Chain-of-Thought Distillation |
| topic | Machine Learning Cryptography and Security Computers and Society |
| url | https://arxiv.org/abs/2512.18174 |