Feedforward
Associative Memory Networks
As it is shown in the next figure,
a basic association network has one layer of input neurons and one layer
of output neurons. An input pattern x is represented as a point in the
N-dimensional real or binary vector space, denoted as
or
, respectively.
Linear Associative Memory (LAM)
An associative memory network is matematically a mapping from an input
space. Associative memory networks can be applied to either auto-association
or hetero-association applications. In the auto-association application,
the dimension of the input space is equal to that of the output space.
On the other hand, in the hetero-association application, the dimension
of the input space and the output space are in general different. The input
and outputs values can be real or binary.
A LAM is a single-layer feedforward
network. The LAM is derived from a set
of input/output pattern pairs
. Here the input is
, and the output is
for m=1, 2,...., M, where
denotes
the transpose of a vector or matrix.The objective of LAM is to recover
the output pattern based on the full or partial information of the input
pattern. We will review two cases: Continuous-Valued
Input Patterns and Binary-Valued Input Patterns
.
Continuous-Valued Input Patterns
Contents
Artificial Neural Networks
About this Tutorial