A simplicity bubble problem and zemblanity in digitally intermediated societies

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Abrahão, Felipe S., Cavassane, Ricardo P., Winter, Michael, Rodrigues, Mariana Vitti, D'Ottaviano, Itala M. L.
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912075633131520
author Abrahão, Felipe S.
Cavassane, Ricardo P.
Winter, Michael
Rodrigues, Mariana Vitti
D'Ottaviano, Itala M. L.
author_facet Abrahão, Felipe S.
Cavassane, Ricardo P.
Winter, Michael
Rodrigues, Mariana Vitti
D'Ottaviano, Itala M. L.
contents In this article, we discuss the ubiquity of Big Data and machine learning in society and propose that it evinces the need of further investigation of their fundamental limitations. We extend the ``too much information tends to behave like very little information'' phenomenon to formal knowledge about lawlike universes and arbitrary collections of computably generated datasets. This gives rise to the simplicity bubble problem, which refers to a learning algorithm equipped with a formal theory that can be deceived by a dataset to find a locally optimal model which it deems to be the global one. In the context of lawlike (computable) universes and formal learning systems, we show that there is a ceiling above which formal knowledge cannot further decrease the probability of zemblanitous findings, should the randomly generated data made available to the formal learning system be sufficiently large in comparison to their joint complexity. Zemblanity, the opposite of serendipity, is defined by an undesirable but expected finding that reveals an underlying problem or negative consequence in a given model or theory, which is in principle predictable in case the formal theory contains sufficient information. We also argue that this is an epistemological limitation that may generate unpredictable problems in digitally intermediated societies.
format Preprint
id arxiv_https___arxiv_org_abs_2304_10681
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle A simplicity bubble problem and zemblanity in digitally intermediated societies
Abrahão, Felipe S.
Cavassane, Ricardo P.
Winter, Michael
Rodrigues, Mariana Vitti
D'Ottaviano, Itala M. L.
Information Theory
Computers and Society
Human-Computer Interaction
Social and Information Networks
In this article, we discuss the ubiquity of Big Data and machine learning in society and propose that it evinces the need of further investigation of their fundamental limitations. We extend the ``too much information tends to behave like very little information'' phenomenon to formal knowledge about lawlike universes and arbitrary collections of computably generated datasets. This gives rise to the simplicity bubble problem, which refers to a learning algorithm equipped with a formal theory that can be deceived by a dataset to find a locally optimal model which it deems to be the global one. In the context of lawlike (computable) universes and formal learning systems, we show that there is a ceiling above which formal knowledge cannot further decrease the probability of zemblanitous findings, should the randomly generated data made available to the formal learning system be sufficiently large in comparison to their joint complexity. Zemblanity, the opposite of serendipity, is defined by an undesirable but expected finding that reveals an underlying problem or negative consequence in a given model or theory, which is in principle predictable in case the formal theory contains sufficient information. We also argue that this is an epistemological limitation that may generate unpredictable problems in digitally intermediated societies.
title A simplicity bubble problem and zemblanity in digitally intermediated societies
topic Information Theory
Computers and Society
Human-Computer Interaction
Social and Information Networks
url https://arxiv.org/abs/2304.10681