r/complexsystems • u/SpaceRascalBacco • 5h ago
Can useful abstractions make a complex system easier to predict?
I have been exploring the idea that intelligence may be related to the ability to discover useful abstractions, ignoring unnecessary details while preserving the relationships that matter for a particular task.
This led me to a question about complex systems: could some of these useful abstractions correspond to emergent macroscopic properties?
I set up a small experiment with a sorting system where elements interact through local rules. I compared predictors trained on the complete microscopic state with predictors trained on a set of macroscopic features I designed. The results were quite interesting. For predicting the global recovery of the system, the macroscopic representation performed better, especially with limited training data.
This is still preliminary research, and the abstractions were hand-engineered rather than discovered by the model. An interesting outcome of this research would be to show that solving some complex problems can become much easier once we find the right abstractions. Of course, the interesting question is whether finding those abstractions can itself be done efficiently.
I wrote a longer article connecting the experiment to Borges, physics, and intelligence. I also created a open-source repository containing the code and the results:
Article: https://giorgiosavastano.github.io/predictive-abstraction/
Repo: https://github.com/giorgiosavastano/predictive-abstraction