Sökning: id:"swepub:oai:DiVA.org:ri-63326" >
Generalized Key-Val...
Generalized Key-Value Memory to Flexibly Adjust Redundancy in Memory-Augmented Networks
-
- Kleyko, Denis (författare)
- RISE,Datavetenskap,University of California, USA
-
- Karunaratne, Geethan (författare)
- IBM Research, Switzerland
-
- Rabaey, Jan M. (författare)
- IBM Research, Switzerland
-
visa fler...
-
- Sebastian, Abu (författare)
- IBM Research, Switzerland
-
- Rahimi, Abbas (författare)
- University of California, USA
-
visa färre...
-
(creator_code:org_t)
- Institute of Electrical and Electronics Engineers (IEEE), 2023
- 2023
- Engelska.
-
Ingår i: IEEE Transactions on Neural Networks and Learning Systems. - : Institute of Electrical and Electronics Engineers (IEEE). - 2162-237X .- 2162-2388. ; 34:12, s. 10993-10998
- Relaterad länk:
-
https://urn.kb.se/re...
-
visa fler...
-
https://doi.org/10.1...
-
visa färre...
Abstract
Ämnesord
Stäng
- Memory-augmented neural networks enhance a neural network with an external key-value (KV) memory whose complexity is typically dominated by the number of support vectors in the key memory. We propose a generalized KV memory that decouples its dimension from the number of support vectors by introducing a free parameter that can arbitrarily add or remove redundancy to the key memory representation. In effect, it provides an additional degree of freedom to flexibly control the tradeoff between robustness and the resources required to store and compute the generalized KV memory. This is particularly useful for realizing the key memory on in-memory computing hardware where it exploits nonideal, but extremely efficient nonvolatile memory devices for dense storage and computation. Experimental results show that adapting this parameter on demand effectively mitigates up to 44% nonidealities, at equal accuracy and number of devices, without any need for neural network retraining.
Ämnesord
- TEKNIK OCH TEKNOLOGIER -- Elektroteknik och elektronik -- Datorsystem (hsv//swe)
- ENGINEERING AND TECHNOLOGY -- Electrical Engineering, Electronic Engineering, Information Engineering -- Computer Systems (hsv//eng)
Publikations- och innehållstyp
- ref (ämneskategori)
- art (ämneskategori)
Hitta via bibliotek
Till lärosätets databas