Grid Cells (Episode 14)

Подписаться 15 тыс.

Просмотров 23 тыс.

50% 1

In this video, we explore the discovery of grid cells. We go over the discovery of these and other location cells in the brain, how they project onto space to represent locations, and how they can be interpreted as SDRs within HTM systems.
We also introduce the concept that grid cells might be used in the neocortex to represent all objects in the brain, not just locations relative to an agent's body.
2014 Nobel Prize Lecture: • Lectures: 2014 Nobel P...
Referenced papers:
- The representation of space in the brain (Roddy M. Grieves, Kate J. Jeffrey):
www.researchgate.net/publicat...
- Network Mechanisms of Grid Cells (Edvard Moser, May-Britt Moser, Yasser Roudi):
rstb.royalsocietypublishing.or...
- Computational Models of Grid Cells (Lisa M. Giocomo, May-Britt Moser, Edvard Moser):
www.cell.com/neuron/abstract/S...
- Evidence for grid cells in a human memory network (Christian F. Doeller, Caswell Barry, Neil Burgess):
www.nature.com/articles/natur...
- Mapping of a non-spatial dimension by the hippocampal-entorhinal circuit (Dmitriy Aronov, Rhino Nevers, David W. Tank):
www.nature.com/articles/natur...
- Organizing conceptual knowledge in humans with a gridlike code (Alexandra O. Constantinescu, Jill X. O’Reilly, Timothy E. J. Behrens):
science.sciencemag.org/content...

Наука

Опубликовано:

30 июл 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 92

@nikosk.736 6 лет назад

This video deserves a lot more views.

@NumentaTheory 6 лет назад

You can help by sharing it with your friends over social media or email. :)

@lextr3110 5 лет назад

the views will grow exponentially for sure

@tyfoodsforthought 4 года назад

The whole series deserves a lot more views! It's cool to be early. 😎

@arielperez3434 6 лет назад

Wow this is awesome. Watched the entire series in two days, excited for what's to come!

@grokspeed 6 лет назад

Hey Matt and team. Just binge watched all 15 episodes in two days and appreciated how both the production quality and your hairstyle evolved for the better over the years. Great job well-done. The visualization helps tremendously.

@GNARGNARHEAD 6 лет назад

you guys never cease to inspire :D I can't wait to hear all about the tricks of grid cells xD have a good one, and thanks again

@chantelleboutin 6 лет назад

This one was really great. It helped bring some of the concepts together. Please keep going.

@MichaelRicksAherne 5 лет назад

This is some awe-inspiring stuff. I'm ready to dive into the open-source. Can't wait for the next video!

@hernandezurbina 4 года назад

awesome video, Matt! Great work

@zacheberhart1564 5 лет назад

What an incredible explanation of such complex ideas -- well done and thank you!

@mdellertson 6 лет назад

Wow, amazing stuff! I'll definitely watch this video again.

@enggei 6 лет назад

Great video! I have been following both Numenta and the Moser's work for years and I am thrilled to see Numenta incorporate the Nobel price winning work into their models. Exciting times indeed!

@hyunsunggo855 6 лет назад

this gives me chills.. no doubt that this'll contribute to the future of HTM a lot!

@williamwilkinson2748 6 лет назад

Great stuff, you guys have got it. I am convinced that from your work will come the machine intelligence that I dream of.

@philoneill9865 5 лет назад

This is amazing. I play drums and while playing I feel like I am moving through space, moving through something, slightly upward and to the right. Although I am sitting still. I wonder if other musicians feel like they are moving. Anyway, this is a really amazing video and I am glad that they are giving the brain its due.

@lasaventurasdevitoelgatoma3405 5 лет назад

Superb, just superb... This is gonna be big someday... Jeff, Matt, all of Numenta keep it up! U may change the world someday!

@MadnessRulesYeah 5 лет назад

Perfect explication. Very clear and dynamic. Thanks :)

@jiaweizhang491 5 лет назад

Thanks, Matt, this is the most intriguing lecture I have ever had on RU-vid, I happened to come up with similar ideas like the SDRs myself earlier in graduate school and when I meet the HTM theory, immediately I found this is the 'home'. Thanks again for those wonderful episodes!!

@odieostrich7718 3 года назад

did you follow up on the SDRs representing concepts ? Will you?

@amandarojas5990 5 лет назад

This was fantastic!!!

@chloeli2948 4 года назад

Thank you for this incredible video. Made all the light bulbs light up!

@fiepps 4 года назад

Someone just posted this on our piazza and I couldn't stop laughing. Can't wait to watch all the other videos!!

@Stwinky 5 лет назад

Thank you form making this video holy moly

@dmlled 5 лет назад

simply, amazing

@danieljohnson3024 6 лет назад

I really like the visualization. I hadn't been thinking of rotating the grids before.

@NumentaTheory 6 лет назад

Another thing I did not mention was anchoring. You can change where the projections intersect with other projections. I hard coded them all to intersect at 0,0 but it could be anything.

@winfriedwilcke1705 3 года назад

Matt, this was wonderful!

@NumentaTheory 3 года назад

Hi Winfried, thanks for your comment, which I know Matt would've appreciated. Sadly, Matt passed away unexpectedly a few months ago. We miss him terribly. numenta.com/company/newsletter/2020/05/12/matt-taylor

@DavidRagazzi 4 года назад

From 12:35 the best part of the video: we see concepts in a spatial perspective! It's just remember that when are learning mathematics in school we make simple operations using visual objects like fruits or hand fingers to understand the results. Furthermore, this new theory explains why is so dificult to us imagine some things like the size of the universe: so many spatial references to draw a big frame of it! Physics, for instance, is all about imagination: you must imagine objects or particles interacting between themselves to understand concepts. This only is possible if your brain manage positions of objects as well their features (compositionality). The new theory (1000s of brains) will clear many lacunes of machine learning not filled by the current approachs.

@NumentaTheory 4 года назад

You get it, David!

@robertpfeiffer4686 6 лет назад

Bravo! One of the best HTM School videos yet. Follow-up questions: 1) What evidence exists that our spatial concepts underlie our temporal concepts? 2) What evidence exists that our egocentric concepts underlie our allocentric concepts?

@robertpfeiffer4686 6 лет назад

One other follow-up question: Do you think that it will turn out to be the case that the entities which were depicted as individual grid cells in this video will turn out to be layers (L6b) of individual cortical mini-columns?

@KonstantinosSamarasTsakiris 6 лет назад

Hi! I'd cite a paper by E. Moser (mentioned in the video) to provide arguments on this question: www.researchgate.net/publication/235376121_Memory_navigation_and_theta_rhythm_in_the_hippocampal-entorhinal_system

@KonstantinosSamarasTsakiris 6 лет назад

@HTM School perhaps it's a good addition to your list of papers?

@NumentaTheory 6 лет назад

I don't think so (that's me Matt speaking). Jeff might think otherwise? I don't know.

@NumentaTheory 6 лет назад

1) temporal without spatial is nearly meaningless. It's like a 1D array. You MUST process more than that to understand reality. Adding "spatial" to the mix means each data point in the 1D array can contain a wealth of information. It's just how reality is, and it makes sense to me that's how the brain represents it. :) 2) I'm not sure, this might not have experimental evidence. This is theory you know. ;) Good thing is that it can be tested.

@tinkrls3r 5 лет назад

this made my day

@JeffHykin 5 лет назад

That animation did a fantastic job of explaining the concept. While this makes huge steps in terms of understanding the brain, it also has some really important implications in computer science and mathematics. The qualities are truly astounding: - tolerant to inaccurate input - probablistically provide location - accurate measure of change (velocity in particular directions) - accuracy benefiting from high dimensionality - similar features being nearby in space - allowing for feature overlap (does not require probabilisticly independent inputs) From a mathematical view, I think it was unclear whether or not that kind of mapping was even possible with finite discrete input. Cryptography and Search engines could likely benefit from this kind of uniqueness mapping of various different features.

@NumentaTheory 5 лет назад

Thanks so much! :D

@PWNonCoD 4 года назад

Amazing video

@DHorse 2 года назад

This is where I really learned something new. About the brain and nn both. Awesome.... That was quick. The half life of comments.

@Pencilbrush1 5 лет назад

Im new to programming and an old fan of Jeff and i will promote this channel as much as humanly possible .

@Pencilbrush1 5 лет назад

One of the principal reasons I'm getting into python and programming is HTM theory and Numenta

@444haluk 3 года назад

After 14 of these dad jokes openings, I kinda learned to appreciate it.

@user-ns2nf6qu3t 11 месяцев назад

I really enjoyed the excellent grid animations. Is that available anywhere to play around with?

@friedrichdergroe9664 4 года назад

As always, excellent content. And the whole grid cell idea might have implications beyond the human brain. I won't say any more.

@dkgaming9152 Год назад

Cells ko train kaise kre

@jburchel 5 лет назад

You all should get the Nobel prize!

@AdityaSingh-hh2jr 5 месяцев назад

Fantastic :)

@addoul99 2 года назад

Incredible

@daviddavid7110 5 месяцев назад

Smartest stuff I've ever whitnessed

@dragolov Год назад

Bravo!

@Tagraff 6 лет назад

Forgive me but I want to take a look at two separate scenarios: A) A mouse sits and it fires at any time upon sitting or resting. B) A mouse moves thoroughly (without rest or stop) and it fires at any time. What's the ratio for non-motion to motion? With open interpretation (combining three possibilities with each respective ratio): High non-motion to Low motion -- It needs to sit in its familiar place that is already registered -- so it doesn't need to learn its own place and has the time to think something else entirely - producing new information, accessing to non-related-memory-to-current-event-or-that-it-keeps-adding-attribution-to-current-event. Low non-motion to High motion -- When it's in the "comfort zone", it's already recorded all the previous-knowledge and there is nothing new to fire. But when it's moving around, all small attribution, details, motion, the gravity that throw the mouse off -- it constantly learning new information and if by some chance, some associative memory is familiarized or triggered, and it keeps adding new sequence whenever it trip, small something new, a change of shade...It doesn't consent to his usual rigid routine -- The nature or its reality keeps 'teaching' to the user of his existence.

@NumentaTheory 6 лет назад

There are other cells in the brain called "speed cells" that respond to an animals speed.

@mariusibanez7654 6 лет назад

amazing video as always, but I get one question : I see how this system work to represent location when you have already your position in the world, you can translate that position to the gird cell. but how does the cell do to know where it is in the world, and so fire. I can see that work by having a internal position in the brain that is update every time you move for example, but how does the mouse does to know where is position is when we put in in the box at first ?

@NumentaTheory 6 лет назад

See paper “Computational models of grids cells” in video description

@ZedBurnett-chophshiy 6 лет назад

Brains re-map whenever one enters a new space; Grids are (re)established by boundaries one senses or recalls.

@tonysouter8095 4 года назад

So presumably one's "map" of a musical work is represented by an analog of grid cells. And perhaps the "internal clock" is related to the entrorhinal-hippocampal system too?

@derstreber2 6 лет назад

@HTM School This is extremely interesting. Do we know what the mouse's knowledge of position (the grid cells firing) is based on? Like distance walked, sense of inertia, or the earths magnetic poles? So many questions... (some that probably matter some that don't, and no I don't expect an answer from you for these) does the position of the grid dots change with different iterations of the experiment? if so does it depend on where the mouse is placed in the room and in what orientation? if the grid does not vary when taking the mouse out, would two separate rooms placed side by side, that are not axis aligned, have a grid that mesh with each other or would the grid orient to the walls of the room? what happens when objects are added to the room? does the mouse grid ever drift, shift, rotate or recalculate over time? does grid cell fire for a sleeping mouse that is moved by someone else? do mice use an A* algorithm on a 3d hexgrid? (I could go on but I won't) Really cool stuff (If you know of where to find more information on these experiments a link would be great.)

@NumentaTheory 6 лет назад

Hopefully you saw the papers I linked in the show description. That is where I got most of this info.

@111foreground 5 лет назад

Triangular lattice, triangular logo, triangulation in Euclidean space; all made possible by hexagons. LMAO!

@andrewm4894 6 лет назад

Looking snazzy today.

@ghostdragonzero 5 лет назад

Where can I find the website where you show the demonstration with the mouse?

@NumentaTheory 5 лет назад

numenta.com/blog/2018/05/25/how-grid-cells-map-space/

@bobsmithy3103 6 лет назад

Very interesting. I wonder if there's been any implementation of that into AI systems.

@NumentaTheory 6 лет назад

Lots of folks working on it!

@Michael-il8ls 3 года назад

are distances same for human and mice, or are they proportional to their body weight?

@galshach 5 лет назад

is the demonstration tool you use starting from 2:25 available online?

@NumentaTheory 5 лет назад

numenta.com/blog/2018/05/25/how-grid-cells-map-space/

@juicyslew4653 6 лет назад

Is the demo used in this video available anywhere?

@NumentaTheory 6 лет назад

discourse.numenta.org/t/how-to-run-htm-school-visualizations/2346

@jabowery 6 лет назад

Excellent video. The 3D grid seems to naturally be tetrahedral rather than strictly orthogonal: A packing of spheres. This extends to hyperspaces as represented in Pascal's Triangle. Is there any way to test this experimentally? Has it been so tested? See Close packing of equal spheres: en.wikipedia.org/wiki/Close-packing_of_equal_spheres

@NumentaTheory 6 лет назад

Haven’t tested it ourselves but that’s how I imagine it.

@zwanzikahatzel9296 5 лет назад

The whole grid cell thing doesn't explain how a grid neuron knows when it's time to fire. In the case of sight for instance if a neuron is sensitive to vertical lines we can easily see how that neuron knows when to fire: if neurons arranged in a straight vertical line on the retina fire, then that particular neuron will know a vertical line has been detected. In the case of space, how does a neuron know that I have moved to the location it's supposed to represent? There must be a whole lot of processing of movement and vision feeding into the grid cells, much like there is a lot of processing done in the retina, before other neurons can know anything about the world.

@NumentaTheory 5 лет назад

Right, we are not explaining how grid cell behavior emerges, but there is tons of research on that in neuroscience today.

@WillowEpp 4 года назад

Curious why you liken it to hexagons, not triangles? Also, why would the third dimension have a different form than the rest?

@NumentaTheory 4 года назад

hexagons are more fun

@WillowEpp 4 года назад

@@NumentaTheory Well, they _are_ a bunch of triangles having a party...

@444haluk 3 года назад

He just turned the dad jokes notch into 11 around 13:40 and they are actually no jokes, but the truth.

@lasredchris 4 года назад

Grid cells - deals with location in the brain Place cells Paper - evidence for grid cells in a human memory network

@superkhoy 6 лет назад

can you link the website you used for the visualization ?

@NumentaTheory 6 лет назад

www.numenta.com/blog/2018/05/25/how-grid-cells-map-space/

@superkhoy 6 лет назад

thanks, man great stuff. You should check out this 3d grid paper www.biorxiv.org/content/early/2018/03/14/282327

@NumentaTheory 6 лет назад

Yes, i read that one too. :)

@tblsaci 6 лет назад

Deep man. Oh wait

@tresorkoffi6435 3 года назад

incredible explanation . RIP Matt You will be missing Numenta s team.

@DHorse 2 года назад

Information is expressed spacially by default for a few reasons. Reuse of course. But on deeper level concepts have a relational space. Or we think they do. Chicken or egg?