https://doi.org/10.1140/epjs/s11734-026-02256-4
Regular Article
Using recurrence microstates to improve learning of multi-layer perceptrons
1
Department of Physics, Federal University of Paraná (UFPR), Curitiba, Paraná, Brazil
2
Interdisciplinary Center for Science, Technology and Innovation CICTI, Federal University of Paraná (UFPR), Curitiba, Paraná, Brazil
a
This email address is being protected from spambots. You need JavaScript enabled to view it.
Received:
18
November
2025
Accepted:
2
March
2026
Published online:
27
March
2026
Abstract
Artificial Neural Networks (ANNs), particularly the Multi-Layer Perceptron (MLP), have become popular for modeling complex functions and solving nonlinear problems. Despite their success, the difficulty in interpreting their internal processes hinders the understanding of many physicists of how hyperparameters, input data, and training techniques influence convergence and overall model performance. In this study, we propose the use of recurrence analysis as an additional tool to examine the dynamic behavior of MLP networks during the learning process. Here, the learning process refers to the supervised classification of different dynamical regimes, where each class corresponds to a distinct parameter value of the underlying system. We apply the methodology to several well-known dynamical systems: the generalized Bernoulli shift, logistic map, the Lorenz attractor, and long memory processes known as colored noise. The results indicate that the microstates quantification changes the way the network interprets the data, varying the weight of the connection between layers and forming patterns on connection weight matrices, especially for larger microstate sizes. Furthermore, we observe that the use of recurrence microstates enables the identification of overfitting, providing a more physically interpretable understanding of the network’s internal dynamics. In summary, recurrence analysis can be used as a complementary approach for interpreting and enhancing the performance of neural networks, especially in tasks involving complex data and dynamical systems.
© The Author(s) 2026
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
