Adaptive Resonance Theory-based Modular Networks for Incremental Learning of Hierarchical Clusterings

Abstract

This paper introduces HART-S, a new modular neural network (NN) that can incrementally learn stable hierarchical clusterings of arbitrary sequences of input patterns by self-organization. The network is a cascade of adaptive resonance theory (ART) modules, in which each module learns to cluster the differences between the input pattern and the selected category prototype at the previous module. Input patterns are first classified into a few broad categories, and successive ART modules find increasingly specific categories until a threshold is reached, the level of which can be controlled by a global parameter called 'resolution'. The network thus essentially implements a divisive (or splitting) hierarchical clustering algorithm: hence the name HART-S (for 'hierarchical ART with splitting'). HART-S is also compared and contrasted with HART-J (for 'hierarchical ART with joining'), another variant that was proposed earlier by the first author. The network dynamics are specified and some useful properties of both networks are given and then proven. Experiments were carried out on benchmark data sets to demonstrate the representational and learning capabilities of both networks and to compare the developed clusterings with those of two classical methods and a conceptual clustering algorithm. A brief survey of related NN models is also provided.

Keywords:

• Keywords: Modular Networks
• Adaptive Resonance Theory
• Hierarchical Adaptive Resonance Theory
• Self-organization
• Hierarchical Clustering
• Mushroom Data Set