Holographic Declarative Memory: Distributional Semantics as the Architecture of Memory

Cognitive Science 44 (11):e12904 (2020)
  Copy   BIBTEX

Abstract

We demonstrate that the key components of cognitive architectures (declarative and procedural memory) and their key capabilities (learning, memory retrieval, probability judgment, and utility estimation) can be implemented as algebraic operations on vectors and tensors in a high‐dimensional space using a distributional semantics model. High‐dimensional vector spaces underlie the success of modern machine learning techniques based on deep learning. However, while neural networks have an impressive ability to process data to find patterns, they do not typically model high‐level cognition, and it is often unclear how they work. Symbolic cognitive architectures can capture the complexities of high‐level cognition and provide human‐readable, explainable models, but scale poorly to naturalistic, non‐symbolic, or big data. Vector‐symbolic architectures, where symbols are represented as vectors, bridge the gap between the two approaches. We posit that cognitive architectures, if implemented in a vector‐space model, represent a useful, explanatory model of the internal representations of otherwise opaque neural architectures. Our proposed model, Holographic Declarative Memory (HDM), is a vector‐space model based on distributional semantics. HDM accounts for primacy and recency effects in free recall, the fan effect in recognition, probability judgments, and human performance on an iterated decision task. HDM provides a flexible, scalable alternative to symbolic cognitive architectures at a level of description that bridges symbolic, quantum, and neural models of cognition.

Links

PhilArchive



    Upload a copy of this work     Papers currently archived: 83,836

External links

Setup an account with your affiliations in order to access resources via your University's proxy server

Through your library

Similar books and articles

How to distinguish memory representations? A historical and critical journey.Marina Trakas - 2019 - Voluntas: Revista Internacional de Filosofia 10 (3):53-86.
Revising psychoanalytic interpretations of the past.J. Timothy Davis - 2001 - International Journal of Psychoanalysis 82:449-462.
Opening the doors of memory: Is declarative memory a natural kind?Kourken Michaelian - 2015 - Wiley Interdisciplinary Reviews 6 (6):475-482.
Memory Changes in Healthy Older Adults.Declarative Memory - 2000 - In Endel Tulving (ed.), The Oxford Handbook of Memory. Oxford University Press. pp. 395.
The role of working memory in motor learning and performance.P. J., W. S. & F. F. - 2003 - Consciousness and Cognition 12 (3):376-402.

Analytics

Added to PP
2020-11-04

Downloads
8 (#1,030,488)

6 months
1 (#497,632)

Historical graph of downloads
How can I increase my downloads?

Author's Profile

Nipun Arora
Carleton University

Citations of this work

Add more citations