Detail of publication

Abstract

Neural principles based on the biological template have become crucial in machine learn- ing in recent years and artificial networks are indisputably SotA classifiers nowadays. Results in multiple specific domains are often fascinating, however, mainstream training methods are hardly ever capable of reaching the optimal behaviour and suboptimal solutions are accepted instead. The missing percents in performance cause unreliable behaviour of trained models and slow down their deployment in real world applications. As demonstrated in Fig. 1 (especially talking about the red box), the mainstream research procedure is based on an iterative tuning of hyper-parameters, collecting new data and increasing the computational power, while the core of the problem - the behaviour inside the trained model is usually kept shrouded in mystery. On the way of developing reliable and meaningfully tunable AI solutions, I find the common approach tilting at windmills and therefore, this work suggests an alternative thinking of how to work with neural principles from scratch. Given a specific classification problem, the objective of the proposed method is to design a tailored (and purposefully tunable) neural network architecture. As illustrated in Fig. 2, the network generation process is based on the multi-agent theory supported by reinforcement learning, where parts of the network (neurons and synapses) are considered to be individual agents. The key idea is to exploit the multi-agent analogy to the network parts and their primitive nature with a local point of view only, while they work together on a global task and emerge some intelligent-like behaviour as a whole (the classification capability).