this paper on memory in intelligent systems from @aidanematzadeh, @seb_ruder, @DaniYogatama at #BAICS2020 was a fascinating read! baicsworkshop.github.io/pdf/BAICS_22.p…
"On the other hand, the ability to forget is a crucial part of the human memory system." this is true! forgetting inessential details and compressing past information is important to help form abstractions for intelligent systems.
"The separation of computation and storage is necessary to incorporate structural bias into AI systems". not many of our favourite neural networks have modular/multiple memory components. the authors suggest that this kind of framework might help avoid catastrophic forgetting!
overall, lots of clear insight and nice comparisons of human memory systems and current neural networks. in general, the blue sky ideas track at #BAICS has lots of fascinating ideas that were very fun to read :-)
• • •
Missing some Tweet in this thread? You can try to
force a refresh
