An Improved Architecture for Cooperative and Comparative Neurons (CCNs) in Neural Network

Md. Kamrul Islam

2007

Abstract

The ability to store and retrieve information is critical in any type of neural network. In neural network, the memory particularly associative memory, can be defined as the one in which the input pattern leads to the response of a stored pattern (output vector) that corresponds to the input vector. During the learning phase the memory is fed with a number of input vectors that it learns and remembers and in the recall phase when some known input is presented to it, the network exactly recalls and reproduces the required output vector. In this paper, we improve and increase the storing ability of the memory model proposed in [1]. Besides, we show that there are certain instances where the algorithm in [1] does not produce the desired performance by retrieving exactly the correct vector from the memory. That is, in their algorithm, a number of output vectors can become activated from the stimulus of an input vector while the desired output is just a single correct vector. We propose a simple solution that overcomes this and can uniquely and correctly determine the output vector stored in the associative memory when an input vector is applied. Thus we provide a more general scenario of this neural network memory model consisting of memory element called Competitive Cooperative Neuron (CCN).

References

  1. Haim Bar, W.L. Miranker, and Alexander Ambash: Competition and Cooperation in Neural processing. IEEE Transactions on Neural Networkks Vol 53, No 3, March 2004
  2. L.C. Rutherford, S.B. Nelson, and G.G Turrigiano; BDNF has opposite effects on the quantal amplitude of pymidal neuron and interneuron exciatory synapses. Neuron, Vol 21, pp521-530, September, 1998.
  3. http://www.wikipedia.org/
  4. J. Singh: Great Ideas in Information Theory, Language and Cybernatics. Newyork, Dover, 1966
  5. D.O Hebb: The Organization of Behavior: A Neuropsychological Theory. Newyork, Wiley, 1949
  6. M. A. Arbib: The Metaphoricalbrain. Newyork: Wiley-Interscience 1972
  7. S. Haykin: Neural Networks, a Comprehensive Foundation. Upper Saddle River, NJ: Prentice-Hall, 1999
Download


Paper Citation


in Harvard Style

Kamrul Islam M. (2007). An Improved Architecture for Cooperative and Comparative Neurons (CCNs) in Neural Network . In Proceedings of the 3rd International Workshop on Artificial Neural Networks and Intelligent Information Processing - Volume 1: ANNIIP, (ICINCO 2007) ISBN 978-972-8865-86-3, pages 48-55. DOI: 10.5220/0001642900480055


in Bibtex Style

@conference{anniip07,
author={Md. Kamrul Islam},
title={An Improved Architecture for Cooperative and Comparative Neurons (CCNs) in Neural Network},
booktitle={Proceedings of the 3rd International Workshop on Artificial Neural Networks and Intelligent Information Processing - Volume 1: ANNIIP, (ICINCO 2007)},
year={2007},
pages={48-55},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0001642900480055},
isbn={978-972-8865-86-3},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 3rd International Workshop on Artificial Neural Networks and Intelligent Information Processing - Volume 1: ANNIIP, (ICINCO 2007)
TI - An Improved Architecture for Cooperative and Comparative Neurons (CCNs) in Neural Network
SN - 978-972-8865-86-3
AU - Kamrul Islam M.
PY - 2007
SP - 48
EP - 55
DO - 10.5220/0001642900480055