Sebastian Seung's Reading List

"This is an obscure reference that most neuroscientists or philosophers will not be familiar with. But it is historically a very important book because Bain is probably the first connectionist. By that I mean the doctrine of connectionism that you have been alluding to, which is that the connections of the brain are extremely important for its functioning. As far as I can tell, he was the first person to propose that you learn things when your connections change. It’s amazing that he proposed that [in 1872], even before neurons were really discovered. He also came up with the first theory of neurocoding, or how the activity of neurons encodes your perceptions or thoughts. “There is a long tradition of studying the brains of geniuses, especially in the 19th century.” He said that there are two ways to do this. One is the idea that out of a huge number of neurons there are some subsets that are active at any given point in time, and that these subsets are a kind of code. Then he proposed that the active neurons might be more or less active, so that is an additional way in which information is encoded. It’s a principle which is still used today. Yes, and he came up with these ideas purely by thinking about it. He’s on the boundary line between two ideas. Connectionism is the successor to associationism. Associationism is the doctrine that enables us to understand all psychology – it’s the idea of association between ideas. People like the philosopher John Locke were associationist philosophers. Connectionism can be viewed as assigning material sub-streams to associations. Somehow, the associations between ideas are represented by the connections between neurons. And Bain was the first person to express that idea."

"This is a fun book by a journalist, describing his adventures driving across America with pieces of Einstein’s brain in the trunk of his car. Einstein’s brain was stolen after he died by Thomas Harvey, the pathologist who performed the autopsy and then absconded with the brain. There is a long tradition of studying the brains of geniuses, especially in the 19th century. Of course it was natural, because neuroscientists wanted to figure out what was different about the brain of a genius. The obvious thing they studied first in the 19th century was brain size. They wondered if geniuses had larger brains in the same way that athletes are brawnier. But there is the famous case of Anatole France and Ivan Turgenev, which I discuss in my book. Turgenev’s brain weighed two kilograms and Anatole France’s brain weighed one kilogram, which are both within the normal range of human brain sizes. My joke is that although they are both great writers, Anatole France is the one who got the Nobel Prize. That’s right. We need to look at more refined measures than size, such as the organisation of neurons. Maybe the variance between different kinds of intelligence has to do with the way our brains are wired. But that’s just a hypothesis. Thomas Harvey had the ambition of discovering what was different about Einstein’s brain, but he didn’t have the scientific capability to try and do it himself, so for years he tried to find partners to study it with him. Some papers have come out, but there is nothing conclusive. There’s one theory about the parietal lobe, which is the part of the brain that’s important for spatial reasoning. That area was enlarged in Einstein, and so may explain why he was so good at that type of thing. Ultimately I reject such explanations as overly simplistic. It’s a great story, though, and there’s a wonderful documentary movie about a Japanese professor’s quest to find Einstein’s brain."

"Marvin Minsky is famous as one of the fathers of artificial intelligence. The Emotion Machine is a summation of his lifetime of thinking about how the brain works. It is written somewhat as a computer scientist but also as a philosopher and psychologist. He’s a brilliant thinker and a brilliant writer. Most people will not know that he actually started out as a neuroscientist. But he gave up on neuroscience, deciding that if he wanted to understand intelligence in his lifetime he had better not study the brain but try to construct it in computer models. This follows up on his previous book, The Society of Mind , in which he updates Freud. Freud thought that we can divide the mind into three parts – the id, the ego and the super ego. Minsky argues that we need many more divisions, maybe hundreds. He thinks about the mind as being the society of these hundreds of regions. And this book continues on that theme. But of course, what we’re interested in in neuroscience is not hundreds of regions but billions of neurons. The question is how we can bridge the gap between those two, and he addresses that question a little bit at the end. Neuroscience is driven by the hypothesis that we don’t need the soul to explain the mind. We don’t know if that hypothesis is true, but it is the working assumption of all neuroscientists. Ultimately, we can understand the mind as the functioning of material processes. That is the idea of materialism. It’s all physical processes. Or there is the idea of mechanism, that we are nothing more than very complicated machines and our parts are made out of neurons or molecules. I pretty much restrict myself to discussing neuroscience, except in the last chapter of my book when I discuss the possibility of uploading. Uploading is the idea that I can transfer my mind to a computer, and then live happily ever after as a computer simulation. Not even terrifying, but for most people just strange! It’s one of the possible routes to immortality that people are thinking about. I call this idea the most contemporary idea of heaven. In some religions, heaven is a place where our souls go after we die. Maybe it’s a pleasant park or something, but we are freed from our bodily existence and our minds somehow waft about – although in some traditions it’s not clear whether it is a purely spiritual existence or some form of reincarnation. The idea of uploading is that you are transferred from your body to a more ethereal form of existence, a simulation of electrical signals in a computer. I think about it as the modern nerd’s idea of heaven. Some people are afraid of uploading because they think of it as being like a brain in a vat – someone being locked up and unable to move around. But that’s limited thinking. Any society that was advanced enough to simulate a brain ought to be advanced enough to simulate the world around the brain. In fact, you could make that world much better than the world which we live in. You could also re-programme yourself to get rid of all of your bad habits and limitations. In that respect you can be a better version of yourself, which is why it’s like heaven. I want to emphasise that these are all fun dreams, but the real question is whether it can ever be possible. There are so many interesting philosophical and ethical implications to uploading, but I don’t see it happening in the near future so I don’t worry about them. I am more focused on how we can improve our brains, rather than how we can escape them."

"This is a picture book of the brain. In the history of neuroscience, we have certainly struggled with our understanding of the brain. One limitation has been our inability to actually see what the structure of the brain is and see how it works. That has been answered by ever more sophisticated technologies for taking pictures of the brain. Finding connectomes relies upon the most powerful microscope you can imagine, and the power to analyse those images. I describe that in my book, but my book is mainly words. If you want to see the images of the brain which have been so important for science, Portraits of the Mind is a wonderful resource."

"JD Bernal was an Irish crystallographer who wrote this book in 1929. He was contemporaries with people like Aldous Huxley , who wrote Brave New World at around the same time. Clearly biology had progressed to a point where people were thinking about the future of human society, and how it could be affected by biology and biotechnology. Bernal wrote this book to talk about human history. He painted his ideas with a broad brush, arguing that humanity had three struggles to understand and control: The world, the flesh and the devil. By the world he means the physical world – advances in technology like electricity which involved the knowledge of physics and applications of engineering. The flesh was biology and biotechnology – the ability to understand how life processes work and to control them. And the final challenge, which he called the devil, was to understand and improve our own minds. The devil was the weakness of our minds. You can argue this question from an extremely philosophical point of view about the implications of physics. A physicist might say that the universe is like a huge assembly of billiard balls all bouncing off each other, representing atoms. Everything is determined by the equations which govern those billiard balls. Therefore, free will is an illusion because everything is determined. I think that is an interesting philosophical debate, but it may be a bit distant from the level at which our minds work. The other notion of free will versus determinism comes from our inability to change ourselves. For example I might smoke cigarettes and want to quit smoking, but I just can’t do it. In principle we know it’s possible to quit, but sometimes it seems almost impossible to change ourselves even if we want to. That is the level where people want neuroscience to have an impact. We know the old-fashioned ways of changing ourselves – the question is whether there are new technologies on the horizon which will enable us to make the changes that we want."