Numenta Logo

MIT Department of Brain and Cognitive Sciences

NumentaNumentaMarcus Lewis and Mirko Klukas
MIT Department of Brain and Cognitive Sciences
WhenTue, Oct 02, 2018 10:00 AM — 11:30 AM
McGovern Boardroom, 46-3160Q 43 Vassar St.
Cambridge, MA USA
WebEvent Website
TopicProcessing sensory(-motor) sequences: Neural networks that work by testing predictions
SpeakingMarcus Lewis and Mirko Klukas


In this talk, we present neural network models that process input over time. We show a predictive mechanism that relies on properties of dendrites that aren’t modeled in traditional point neurons. We combine this mechanism with location representations based on grid cells to create neural networks that process different types of input sequences. This predictive mechanism involves a population of neurons that each has “proximal” and “distal” integration zones on its dendrites. The distal input acts as a predictive signal, while the proximal input gives the cell its classical receptive field and is used to test which predictions are accurate. The population forms a conjunctive representation of the two inputs. To process extrinsic sensory sequences, we allow this population to learn recurrent connections on distal dendrites, and this causes it to implement sequence memory resembling the Lempel-Ziv compression algorithm. To process input sequences caused by self-motion, we add a second population of neurons resembling grid cells which represent a location and perform path integration, and the two populations learn a spatial map. Neural networks built around this predictive mechanism recognize sequences and locations from ambiguous sensory inputs by activating multiple representations, using these representations to make predictions, and using subsequent input to disambiguate.

NumentaNumentaMarcus Lewis and Mirko Klukas