Cellular Automata Can Reduce Memory Requirements of Collective-State Computing

• Various nonclassical approaches of distributed information processing, such as neural networks, reservoir computing (RC), vector symbolic architectures (VSAs), and others, employ the principle of collective-state computing. In this type of computing, the variables relevant in computation are superimposed into a single high-dimensional state vector, the collective state. The variable encoding uses a fixed set of random patterns, which has to be stored and kept available during the computation. In this article, we show that an elementary cellular automaton with rule 90 (CA90) enables the space-time tradeoff for collective-state computing models that use random dense binary representations, i.e., memory requirements can be traded off with computation running CA90. We investigate the randomization behavior of CA90, in particular, the relation between the length of the randomization period and the size of the grid, and how CA90 preserves similarity in the presence of the initialization noise. Based on these analyses, we discuss how to optimize a collective-state computing model, in which CA90 expands representations on the fly from short seed patterns--rather than storing the full set of random patterns. The CA90 expansion is applied and tested in concrete scenarios using RC and VSAs. Our experimental results show that collective-state computing with CA90 expansion performs similarly compared to traditional collective-state models, in which random patterns are generated initially by a pseudorandom number generator and then stored in a large memory. 

Ämnesord

NATURVETENSKAP  -- Data- och informationsvetenskap -- Datavetenskap (hsv//swe)

NATURAL SCIENCES  -- Computer and Information Sciences -- Computer Sciences (hsv//eng)

Nyckelord

Automata

Cellular automata (CA)

collective-state computing

Computational modeling

Decoding

distributed representations

hyperdimensional computing

Memory management

Neurons

random number generation

reservoir computing (RC)

Reservoirs

rule 90

Task analysis

vector symbolic architectures (VSAs).

Cellular automata

Job analysis

Memory architecture

Network architecture

Random processes

Reservoir management

Automaton

Cellular automaton

Cellular automatons

Computational modelling

Distributed representation

Memory-management

Random-number generation

Reservoir Computing

Vector symbolic architecture .

Publikations- och innehållstyp

ref (ämneskategori)

art (ämneskategori)