Exploring Simplicity Bias in 1D Dynamical Systems

• Published in: Entropy (Basel, Switzerland) Vol. 26; no. 5; p. 426
• Main Authors: Dingle, Kamal, Alaskandarani, Mohammad, Hamzi, Boumediene, Louis, Ard A
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 01-05-2024
• Subjects: algorithmic probability; Algorithms; Approximation; Bias; Codes; Complexity; Data compression; Dynamical systems; Information theory; Parameters; Physics; Probability; simplicity bias; Time series; Upper bounds; United Kingdom; Germany; dynamical systems; time series; algorithmic probability; simplicity bias
• ISSN: 1099-4300; 1099-4300
• DOI: 10.3390/e26050426

Arguments inspired by algorithmic information theory predict an inverse relation between the probability and complexity of output patterns in a wide range of input-output maps. This phenomenon is known as
By viewing the parameters of dynamical systems as inputs, and the resulting (digitised) trajectories as outputs, we study simplicity bias in the logistic map, Gauss map, sine map, Bernoulli map, and tent map. We find that the logistic map, Gauss map, and sine map all exhibit simplicity bias upon sampling of map initial values and parameter values, but the Bernoulli map and tent map do not. The simplicity bias upper bound on the output pattern probability is used to make a priori predictions regarding the probability of output patterns. In some cases, the predictions are surprisingly accurate, given that almost no details of the underlying dynamical systems are assumed. More generally, we argue that studying probability-complexity relationships may be a useful tool when studying patterns in dynamical systems.