LESSWRONG
LW

Personal Blog

7

[LINK] IBM simulate a "brain" with 500 billion neurons and 100 trillion synapses

by drnickbone
21st Nov 2012
1 min read
23

7

Personal Blog

7

[LINK] IBM simulate a "brain" with 500 billion neurons and 100 trillion synapses
5Stabilizer
5gwern
1drnickbone
0John_Maxwell
7RomeoStevens
2mapnoterritory
-8noen
13loup-vaillant
-4noen
5Emile
5fubarobfusco
0noen
2loup-vaillant
-4noen
4Emile
3loup-vaillant
6khafra
0JoshuaZ
-4noen
2JoshuaZ
0ChristianKl
-7noen
-14[anonymous]
New Comment
23 comments, sorted by
top scoring
Click to highlight new comments since: Today at 8:22 AM
[-]Stabilizer13y50

I think important caveats need to be kept in mind. From the New Yorker article:

I.B.M.’s Compass has more neurons than any system previously built, but it still doesn’t do anything with all those neurons. The short report published on the new system is full of vital statistics—how many neurons, how fast they run—but there’s not a single experiment to test the system’s cognitive capacities. It’s sort of like having the biggest set of Lego blocks in town without a clue of what to make out of them. The real art is not in buying the Legos but in knowing how to put them together. Until we have a deeper understanding of the brain, giant arrays of idealized neurons will tell us less than we might have hoped.

Reply
[-]gwern13y50

The full paper might be useful: http://conferences.computer.org/sc/2012/papers/1000a085.pdf

Reply
[-]drnickbone13y10

Thanks for this. The latest research report 10^14 already appears to be a significant update on that paper.

IBM now report roughly eight times as many simulated neurons and synapses, while the slow-down has gone from ~400x real-time to ~1500x real time. That works out at a factor > 2 in hardware improvement within a matter of months. They are using a custom hardware architecture and presumably there are still a lot of optimisations to be made. It can't be very long before this can run in real time.

As said in other comments, nobody knows how to program this yet...

Reply
[-]John_Maxwell13y00

The paper seems to indicate that the sim is running 388 times slower than real-time. I guess we're not 100% there hardware-wise yet? Good.

Reply
[-]RomeoStevens13y70

this is worryingly fast IMO.

Reply
[-]mapnoterritory13y20

I actually never heard about non-von Neumann architectures. Anybody has some tip on a good source on this? Especially how this relates to biological brain architectures? Thank you!

Reply
[+]noen13y-80
[-]ChristianKl13y00

It's nothing like a real brain simulation, of course, but illustrates that hardware to do this is getting very close.

They simulate model neurons. Those neurons they are less complex than the real neurons that we have in our head. The way in which real neurons change the amount of ion channels on their membrane for long-term plasticity is neither fully understood nor easy to simulate.

Reply
[+]noen13y-70
[+][anonymous]13y-140
Moderation Log
More from drnickbone
View more
Curated and popular this week
23Comments

Recent article in The New Yorker:

http://www.newyorker.com/online/blogs/newsdesk/2012/11/ibm-brain-simulation-compass.html

Here is the research report from IBM, with the simple title "10^14":

http://www.modha.org/blog/SC12/RJ10502.pdf

It's nothing like a real brain simulation, of course, but illustrates that hardware to do this is getting very close. 

There is likely to be quite a long overhang between the hardware and the software...