Briefly:
I wrote about homomorphically encrypted consciousness. I don't think it's paradoxical. I think you could imagine receiving evidence that you were in homomorphic encryption (simulation hypothesis variant). I don't think the 'input' thing is paradoxical. An LLM is receiving something like 'GPU voltage macrostates' as input, it doesn't need to have a felt sense of this.
I wrote Mental causation is not load-bearing, which argues that epiphenomenalism is less central to the epistemic problem, than is lack of intelligible supervenience. (So this is saying that type A physicalism e.g. analytic functionalism can more easily accomodate knowledge of one's own consciousness states.) Russellian monism can perhaps save mental causation on-paper but seems vulnerable to the standard epistemic objections nonetheless.
Nevertheless I think illusionism has a lot going for it, Keith Frankish seems more reasonable than phenomenal realists I have read such as David Chalmers and Philip Goff. Of course there is a state it is easy to know one is in which is reasonable to call "consciousness" on an ordinary language basis, but this need not qualify as the philosopher's "phenomenal consciousness" or "qualia", which they sometimes conceptually analyze as non-physical.
These days it’s good to be aware of the https://www.lesswrong.com/posts/NyiFLzSrkfkDW4S7o/why-it-s-so-hard-to-talk-about-consciousness post by Rafael Harth describing division of people into Camp 1 and Camp 2 with regard to the issues of phenomenological consciousness and qualia and of the discussion in the comments to that post.
It often seems to me that the hard problem of consciousness is equivalent to "Why are people dissatisfied with easy explanations of consciousness?"
:-) But are you from Camp 1 or from Camp 2? :-) That should be the starting point of a discussion on this subject :-)
If you are from Camp 1, I don’t have much to say (how to have generally fruitful intercamp communications on this subject is an unsolved problem at the moment, and we don’t even know if the subjective realities of people from different camps are similar; in the comments to that post I referenced, Carl Feynman, who is a prominent representative of Camp 1, conjectures that subjective realities of different people differ more sharply than it is usually assumed; I don’t know to what extent his guess that intercamp differences are due to that is correct, but this is an interesting question to ponder).
But if you are a fellow Camp 2 member, then what could be a simple explanation of the structure of the variety of qualia I am observing?
We don’t even have a good description of qualia, and we don’t understand the nature of the space of my subjective colors, and so on. We might have some conjectures, some attempts to approach that, but I don’t see much progress.
I have some ideas on how we might be able to actually make some progress here, but that would be a longer text.
Now what consciousness is for is a different story. This indeed seems to have a decently simple explanation (roughly speaking, it seems to facilitate better “generalized introspection”, which improves predictive power, which improves survival and fitness; so functionally speaking, this does seem to be a plausible story).
So if one wants an evolutionary explanation of why it is selected for, this looks like a plausible story. And this part might be where the two camps more or less agree.
But, from a typical Camp 2 point of view, this does not solve the mystery of subjective phenomenology, that just explains why it might be evolutionary helpful to have something like that.
No, people will be dissatisfied with the answer to that too. The Easy Problem of Consciousness 2.
While there are a few curious things you can do with homomorphically encrypted consciousnesses, it's mostly unnecessary set-dressing when you consider how far natural hardware already is from a natural abstraction. Locating a consciousness under encrypted computation really isn't structurally all that different to locating consciousness running on this particular class of hardware.
it’s a mysterious force permeating the entirety of the universe which lies in all things, but doesn’t have any detectable causal impact on the world beyond that described entirely by mundane theories
(Jeopardy! answer) What is, temperature?
If a homomorphically encrypted system is conscious, then it must be the encrypted computation that is conscious, not the decryption, since decrypting text probably doesn’t produce consciousness.
I disagree with this actually. You can always come up with a "decryption" scheme which would produce a specific computation as a result of some arbitrary string of text. And it seems clear that there's a sort of spectrum between non-encryption and this sort of arbitrary decryption, such that you can pass arbitrary amounts of the "real" computation between the actual process and the decryption process (e.g. by encoding some low resolution version of the computation, and then "decrypting" it in a way which fills in the remainder).
Or from an anthropic point of view, I can take a nice, easily described universe, and then point to my location within it, and this is a certain number of bits. And my guess is that my anthropic measure has to do with this length, as integrated over all structures where this process results in a canonical description of my consciousness. The lawfulness of the universe makes locating me far more easy than as a Boltzmann brain, and for the same reason, than as a highly encrypted brain.
I assume it's possible to have homomorphic encryption where the key is verifiable. Like if you randomly guessed it, you would be able to decrypt, and if you guessed wrong, you would know you failed to decrypt. The "key checking process" could even be memory-light. In which case it looks like in a "encrypt -> compute -> decrypt" process, the "decrypt" can't be doing consciousness, because it's a massively parallelizable, memory-light guess-and-check.
Ok, that's fair actually. Maybe you do think the encryption and decryption involved in homomorphic encryption produces consciousness
I am kind of confused about how we all collectively agreed to refer to the exact same feeling as “consciousness” while the details of it are in such great dispute.
I don't think anyone's really defined or measured the feelings to the point that we have ANY IDEA whether they're the exact same, or even what "exact same" means. Most of us have agreed to refer to SOMETHING we each experience using this word, and some superficially-similar descriptions of "inner experience", and "being there".
Also, no, I don’t just feel it, man. Sorry about that.
You're the first presumed-person I've encountered to claims not to feel it. Fascinating. Would you classify yourself as a P-Zombie, or do you have some other description of the thing that feels valence and preference over your experiences and behaviors?
(note: I'm very agnostic on free will - I suspect it's illusion. But I definitely do experience something I call consciousness, and I find it easy to believe that other humans are rather similar in their experiences).
I wouldn't really consider myself a p-zombie, I think, since if I lack something that other humans lack it is likely a strong feeling that I am conscious, which isn't necessarily related to any actual thing that people might refer to by "consciousness"
I also find your writing and implied experience very strange. I remember the "this is me" feeling from quite a young age and definitely feeling it was important, something I felt without having it explained to me first, and a feeling that came first, before words to express it. In other words the origin of it wasn't me being expected to talk about my feelings, but something that bubbled up from myself. However I definitely wouldn't consider you a p-zombie as I believe animals with much less introspection than you have qualia, feel real pain etc and it is unethical to ignore that.
Out of curiosity how big is your ego? I mean this in a curious, non-threatening way, as in do you consider yourself to be important, both good or bad? Do you care about continuing to exist as much as others around you do? Do assaults on your self, such as social roastings actually hurt and cause you to keep going over them in your head so as to avoid in the future?
It may be simply that there is much less recursive "think about yourself" going on naturally in your brain. Like if you must think about nothing for say 10 mins, do your thoughts come back to yourself?
I think you can define/measure something similar, the default mode network (DMN). The literature/AI thinks
Yes, the default mode network is related to some feelings people associate with consciousness, especially, selfhood, autobiographical memory, mind-wandering, inner narrative, rumination, imagining the future, “me-ness". DMN activity seems closely related to the narrative/self-reflective layer of consciousness, not necessarily raw sentience or being awake at all.
It wouldn't surprise me if the feeling of consciousness if pretty strongly correlated with this, and it can be measured. Having a very weak DMN however doesn't make someone a p-zombie.
I can't tell from the post whether you yourself have any guesses as to what people are trying to point to when they talk about "consciousness" (presumably phenomenal consciousness).
I agree that I am capable of modeling and thinking about myself.
Some questions that might serve as intuition pumps (and also give me a better idea of what you might be missing, if anything):
Are you capable of introspecting on your sensory experiences? Like, if your arm is resting on the edge of your desk, can you deliberately pay attention to the sensation of your arm resting on the edge of the desk, notice various things about it, maybe consider how it differs from other sensations you're having at that moment (or have had in the past)?
Do you have any sort of mental narration going, either constantly, or when you start paying attention to whatever you're thinking about? Does the idea of deliberately paying attention to whatever you're currently thinking about make any sense to you? Does the idea of that act of paying attention generating sensory information that you feel/experience the same way you feel/experience many other sensory inputs make any sense to you?
Are you capable of introspecting on your sensory experiences? Like, if your arm is resting on the edge of your desk, can you deliberately pay attention to the sensation of your arm resting on the edge of the desk, notice various things about it, maybe consider how it differs from other sensations you're having at that moment (or have had in the past)?
Yes, this is something I can do. I don't think this necessitates consciousness, I can definitely deliberately choose to process the sensation in more detail and compare it to remembered inputs in the past, but this just requires being able to remember previous inputs.
Do you have any sort of mental narration going, either constantly, or when you start paying attention to whatever you're thinking about?
Yes, very much so. I also don't think this necessitates consciousness. Obviously, mental narration isn't fully textual, but it's close enough that you could compare it to a program which writes down text on a scratchpad and reads it back into its inputs.
Does the idea of deliberately paying attention to whatever you're currently thinking about make any sense to you?
Uh, if I'm thinking about it presumably I am already paying attention to, but yes if I want to I could choose to pay more attention to a given thing.
Does the idea of that act of paying attention generating sensory information that you feel/experience the same way you feel/experience many other sensory inputs make any sense to you?
If you're referring to the idea of somatic sensations, I'm familiar.
(To clarify, none of those were meant to be examples of things that I believe require consciousness, though maybe some of them are by accident.)
It sounds to me like you're mostly taking issue with people's inability to precisely specify what they're talking about, rather than claiming that you lack any notion of (or, uh, experience of) "being a thing that has experiences".
I have a notion of specific abilities people can have, but people seem to think they have some sort of experience beyond that which is related to/caused by the abilities.
I have written a response post, mainly pointing out that the denialist move here stems from failure to understand any of the existing coherent and useful meanings for qualia/experience.
I there explain and argue that qualia is a useful concept, notably to talk about preferences over qualia, as illustrated by the existence of artists who want to create particular experiences, eg. the experience of green. They don’t care about lightwave frequencies, they want to create the experience. There are multiple ways to get there, maybe with direct stimulation of eye cones, maybe with psychedelics, maybe with brain modification.
Understanding the above should clear some of the confusion as to why people talk about qualia. It's useful.
What will happen when Mary is released from her black and white room or is given a colour television monitor? Will she learn anything or not?
I think the ability hypothesis is pointing out that Mary has propositional knowledge of colour but lacks procedural knowledge, and the acquaintance hypothesis is supposed to point towards what you are looking for in this essay; qualia. But, as you said, the explanatory quote you provided doesn't exactly help.
What if, instead of Mary being released or given a fancy new tv, she is simply given a color wheel? It has no writing or other symbols, only the full spectrum of colors detectable by the human eye. She is an expert already so she will immediately know what it is, but could she tell you which side is blue? Would she associate the side that we call 'red' with 'hot'?
I actually don’t think that’s a funny question. I know of one historical example of someone who got into a traumatic accident, and afterwards claimed that he stopped being conscious.
Scott's patient is conscious in at least one sense, the medical sense,because they are not in a coma or sleepwalking. That's quite compatible with not being conscious in other senses , such as lacking a sense-of-self, higher order thought, phenomenality, etc. These could be different things that happen to co-occur in healthy adults, in the same way that healthy people have all three of a heart, stomach and liver.
(But Scott seems to be talking about Simon Browne, the Zombie Preacher of Somerset, who did not describe himself as lacking consciousness, in so many words).
There's no need to find the one true definition of "consciousness", it's a fake problem. But the problems of consciousness are real.
This is primarily because every time I ask someone what they mean when they say consciousness, they either have their own theory about what it entails and what causes it, which differs from everybody else’s theories, or they say, “I don’t know, you can kind of just feel it, man.
Yes. They have different theories. That's not the same.things as different definitions, Even though there are multiple definitions, as well. The existence of multiple definitions doesnt support illusionism, and in fact, makes things difficult for the illusionist.
while the details of it are in such great dispute.
The theories are rivalrous, the definitions don't have to be.
While I can’t dispute the “just feel it, man” argument, I am kind of confused about how we all collectively agreed to refer to the exact same feeling as “consciousness” while the details of it are in such great dispute. Also, no, I don’t just feel it, man. Sorry about that. Maybe I’m traumatized
It's not diffucult to understand. Experience relates to perception as opposed to cognition, tasting the wine rather than reading the label.
Ok, but this is kind of a degenerate case of “subjective experience”. Clearly, when people say “subjective experience” they refer to… some sort of internal state of being that isn’t understandable from the outside
Note that there is a cascade of claims here:
That experience/perception exists,
That it is different from cognition,
That it can't be accessed by persons other than the one having it ,
That it can't be understood or described
That it is non physical.
(5 is particularly problematic.There are people who think they are zombies, because they think they have no qualia, even though they have common or garden sensory perceptions with common or garden sensory qualities ... because they think qualia need to be noticeably, not just arguably, mysterious or nonphysical.
Scott did not misunderstand my question, and that is in fact his stance on illusionism (“I’m increasingly convinced it’s an equivalent of aphantasia”), al
Almost everyone who hasn't spent a long time studying the subject is likely to suffer from confusion about the concepts, and almost no one has spent a long time studying the subject. So there is a lot of conceptual confusion about, and that would make conceptual confusion a much likelier explanation of claims of zombiehood than rare neurological conditions ).
It seems Nagel doesn’t have a definition either, other than “I don’t know, you can just feel it, man”
That's not a problem so long as you, in fact, can. There's no reason to suppose that everything that exists has an abstract definition. Nor is there any reason to suppose that ostensive definition, the philosophical jargon for pointing at something and saying "its one of them" , always fails.
All in all, I would agree with the ability hypothesis the most, or perhaps with Daniel Dennett’s claim (I believe this is from Consciousness Explained, although I am not sure) that actually our intuitive sense that she would learn something is wrong, because we’re bad at imagining a Mary who actually knew everything there is to know about vision
Ok, but that's only an objection to 5. You are not here saying you don't know what "experience" means, or that you don't have it. You are saying that you are unconvinced by by nonphysical theories of consciousness.
Perhaps you have fully bought into my arguments for illusionism
So far I have not noticed you give an argument for illusionism.
But of course, this goes the other way as well. I have no idea whether or not I am simply missing some important experience, such that if I had it, I would automatically believe in consciousness
Ehy does it have to be important? Ordinary everyday conscious experience is still consciousness.
What I am more skeptical of is the described link between that phenomenon and the things people believe about that phenomenon, just as I believe that people who profess to possess a soul or a spiritual connection to God describe a real experience, while not necessarily believing their claims about that experience.
That's not illusionism. That's disagreement with some theories of consciousness. Which? You don't say.
I could very easily believe that someone who murdered someone and then described experiencing a severing of their connection to God and morality and feeling like they were damned and soulless was simply experiencing extreme guilt over their ego-dystonic actions, rather than something more phenomenologically fundamental. Thus, I am placing his situation into the “idk people are kind of crazy” bucket.
I could equally believe that, for instance, higher order thought can disappear, since its absent in animal, young children, and sleepwalkers.
Of course claims to consciousness involve i) an interpretation of ii) a phenomenon. Claims to everything else do! Noticing that fact doesn't give you an argument for. illusionism because it only gets you as far as "claims to consciousness might be a confused interpretation of a real phenomenon". Illusionism worthy of the name needs claims more like " consciousness is definitely a confused interpretation of a real phenomenon" or "there is no phenomenon".
Possibly what is confusing you is that some people talks as though there is no difference between i) and ii), as if you are supposed to know that you are conscious in a single swoop. People tend to apply interpretations automatically and unthinkingly , not noticing that they are optional interpretations (like the Zombie preacher who , being a preacher, interpreted his symptoms as soullessness.).
But the more sophisticated a defender of consciousness is, the less likely they are to be doing that. Inasmuch as you have an illusionist argument you are not addressing the strongman case for taking consciousness seriously. The illusionist needs to make phenomenon/interpretation distinction, too.
I wouldn’t really consider myself a p-zombie, I think, since if I lack something that other humans lack it is likely a strong feeling that I am conscious
A feeling or a thinking?
Without getting into definitions and theories of consciousness, which feelings, which phenomena, so you lack?
Awareness of, and ability to respond to, surroundings
Ability to report on mental content
Phenomenality ,sensory qualities
Sense of self
Recursive, higher order thought.
(Of course, one is very unlikely to lack all of these, which is why "I know Im conscious" seems. obvious. Yet it could be an illusion or delusion that consciousness is a single atomic thing that is either wholly present or wholly absent).
I am not a hardline illusionist, and I am very open to the possibility of being wrong. I am currently undecided, and am more of a consciousness skeptic than anything else.
Sceptical about the phenomenon or the interpetation? Previously you said
What I am more skeptical of is the described link between that phenomenon and the things people believe about that phenomenon
Ok. So you don't like , maybe, dualism or epiphenomenalism. That doesn't make you an illusionist.
Free-will is a brain-concept that most people use
" Free will" labels multiple concepts.
often seems to me that the hard problem of consciousness is equivalent to “Why are people dissatisfied with easy explanations of consciousness
So what is it?
I was going to write up an essay earlier on the topic but held off because real work and I saw you had tweeted about doing a write up covering similar topics. It seems to me what people get "wrong" about the zombie, conciousness etc debate is a matter of first principles.
I think we (understandably) over-empasize definitions sometimes, which becomes a key problem. Try to approach the problem from both directions, from the bottom modeling and applying models to the world and from the top (more akin to Descartes' approach) observing and making inductive inferences from there. Neither side can provide us strict 'proof' but provide useful ways to think about the problem.
From the bottom up:
Imagine at the level of first principles modeling the abstract terms without reference to the physical. This is what math is about: I can do calculations using the Pythagorean theorem (a^2 + b^2 = c^2) to make useful calculations of distances when I map that relationship onto real world things. Defining a in terms of real world phenomena would be less than unhelpful.
What is conciousness in such a model? You might say your model includes some functions that model themselves and you are calling that conciousness, okay how helpful is that to understanding the world? How well does it map on to what we see in the world?
My senses are aware of something, call it qualia perhaps, does this map on to the same term?
We can think of our senses from the top down instead:
"I" have this experience. What is the basis for the experience? It seems to be have strong causal ties to neurological activity which and responses to stimulus which I can observe from my nervous system and brain studies. Okay, do others have an analogous experience? Well they, like me, report having something similiar, and when we cut open their brains and look at how they respond to stimuli so it is reasonable to say that the explanation that best fits those observations is that there are analogous experiences going on in them. Okay, do animals have the same? Well, they seem to share the same mechanism and many of the responses to stimuli to various extents, some are nearly identical to us. Some seem to also be able to perform similiar tasks which require responding to stimuli and modeling themselves. So to varying extents we can deduce with various confidences this data is best explained by some sort of analogous experience. Okay what about a camera? Not so much, the same analyses cannot be applied. How about an LLM? Maybe we see some of the same actions, possibly we even can get it modeling itself, but we don't have the same mechanisms and at a granual level the responses to stimuli are quite different (they lack nervous systems, of course) so we cannot deduce an analogous experience.
------
After all that we are left with the "so what?" What does it mean if something is concious? Are we going to apply what we infer to utilitarian calculations and say "if i infer you have qualia, then I place utility on your experience so it is wrong to kill and eat you, but if you lack qualia then your experience is without utility so if it improves my utility killing and eating you is a good thing, actually"? Does your understanding of the world with it lead to different policies and approaches? These involve quite a bit of subjective reasoning, so I will leave any reader to try to think them through and answer themselves.
I have inside a thing I can choose to feel confused about in (what I think is) the same way as other people that speak of qualia. I wouldn't think to do this if other people didn't tell me, and I don't have a strong opinion on if it's a bad or good idea.
Part of me feels that that confusion is silly, but it's not (yet) clearly-silly like being confused about free-will.
Free-will is a brain-concept that most people use, which can be used well or poorly, or perhaps be discarded; very similar is the sense of self. Also nearby (though less arbitrary) are the distinction between predicting and planning, and similarly the division of expected-utility into expectation and utility.
Maybe the perception of qualia is a similar feeling, or something?
Another thing to consider is reversible computing. If I'm run forward and then backward, do they cancel out or what? I don't find this that interesting but you might.
contra scott alexander (?)
Yesterday, I went to the Berkeley ACX Meetup. Scott Alexander was there, and ran a Q&A session where participants could ask him questions and he would respond to them unless the questions were about eulogies, in which case he would pause to think for a few seconds before kindly passing. At one point or another, the questions drifted to theories of consciousness.
As a kind-of-illusionist, I worked up the courage to raise my hand and ask him what I should do if I wasn’t sure if I was conscious. Everybody laughed at this question, and while I expected Scott to respond to the philosophical point, he instead said (paraphrased from memory, may not be accurate),
Now, this was such an epic roast[1] that it took me several minutes to work up the courage to raise my hand again, and clarify that I actually wanted to hear his thoughts on illusionism.
At this point, I had already asked him two questions about this, I was still reeling from his first response, and I didn’t want to devolve the entire Q&A into a discussion on consciousness between Scott and I, so I sat meekly there for the rest of the meetup. However, this meant I did not actually get a chance to discuss my theories of consciousness, so now I am inflicting it on my online audience.
What is consciousness?
I think Scott’s challenge, asking how I would define consciousness such that people don’t have it, is entirely fair. This is also how I would respond to people who claim that free will is nonexistent, for example. Unfortunately, I don’t have a good response to this question. This is primarily because every time I ask someone what they mean when they say consciousness, they either have their own theory about what it entails and what causes it, which differs from everybody else’s theories, or they say, “I don’t know, you can kind of just feel it, man.” While I can’t dispute the “just feel it, man” argument, I am kind of confused about how we all collectively agreed to refer to the exact same feeling as “consciousness” while the details of it are in such great dispute. Also, no, I don’t just feel it, man. Sorry about that. Maybe I’m traumatized!
Consciousness as subjective experience
I agree that I have access to sensory inputs which other people don’t have access to. As I understand it, this fulfills the “subjective” part of “subjective experience”, but so does a camera (Yes, you can then go and view the image later, but a talented artist can also draw a very detailed reproduction of what they’re seeing, so clearly that’s not disqualifying). I’m a bit less sure about what the “experience” part of this refers to. I understand what the word means in other contexts, but in my [WORD THAT IS NOT EXPERIENCE], when I press people on this point they say, “It’s obvious!” It is, unfortunately, not obvious to me. Maybe everybody else had a meeting where they agreed to use “experience” to refer to this obvious thing, and I missed it?
Ok, but this is kind of a degenerate case of “subjective experience”. Clearly, when people say “subjective experience” they refer to… some sort of internal state of being that isn’t understandable from the outside? Like thoughts, or feelings? Do they have to be undetectable with an MRI?
Wikipedia’s page on subjective character of experience suggests that the term was coined by Thomas Nagel, so presumably he has a definition. Let’s see what Mr. Nagel has to say!
If extremists are prepared to deny it of mammals other than man, then we are forced to face the question, “What am I, chopped liver?” It seems Nagel doesn’t have a definition either, other than “I don’t know, you can just feel it, man”. As someone who has shed my faith that there is experience there at all at this juncture in the phylogenetic tree, it seems I unfortunately cannot find my salvation in Nagel.
Mary’s Room
Mary’s room, also known as the knowledge argument, is a famous thought experiment posed by Frank Jackson in 1982, as an argument against physicalism. In this case, it can also serve as an argument against illusionism. In its original formulation, he writes:
Now, I do have a strong intuitive sense that Mary will learn something new upon leaving the room. It might seem like we’ve finally found qualia/consciousness/sentience/whatever, but the thought experiment has been around for a while, and physicalists have already come up with a few common responses to it.
The ability hypothesis says, “Well, imagine that you spend all your time reading every snowboarding[2] guide ever published, watching countless snowboarding videos, reading every academic text published on snowboarding. Do you know how to snowboard? No? Well this is stupid, then.”
The acquaintance hypothesis, by Earl Conee, claims that the knowledge Mary gains is not factual knowledge, nor is it an ability, but rather a third type of knowledge, which he dubs “acquaintance knowledge.” Acquaintance knowledge “requires the person to be familiar with the known entity in the most direct way that it is possible for a person to be aware of that thing”. This might be a helpful definition for people who intuitively know what he means by “the most direct way that it is possible”, but unfortunately I yet again do not.
The old fact/new guise analysis suggests that Mary doesn’t learn anything new, but instead learns a new understanding of what she already knew. Now, I’m not entirely sure what it means to not learn something new but instead to learn something new. Amy Kind, who laid out these three different responses[3] in her book, “Philosophy of Mind: The Basics", cites the example that you might know Bruce Wayne is 6’2” tall, but you can also express this by saying that Batman is 6’2”, or that “Bruce Wayne mesure 1.8796 mètres“. Now, I’m pretty sure for the first one you would need to have the knowledge that Bruce Wayne is Batman, and for the second one you would need to know how to speak French and convert between the imperial and metric systems, so unfortunately I don’t really understand what this is saying.
All in all, I would agree with the ability hypothesis the most, or perhaps with Daniel Dennett’s claim (I believe this is from Consciousness Explained, although I am not sure) that actually our intuitive sense that she would learn something is wrong, because we’re bad at imagining a Mary who actually knew everything there is to know about vision.
Molyneux’s Puzzle
In the 17th century, philosopher William Molyneux asked John Locke, “Let’s say that someone born blind learned to distinguish objects by touch. For example, they might be able to tell the difference between cubes and spheres. Now, if we restored the blind man’s sight, would they be able to tell which was which by sight alone?”
Molyneux’s wife was blind, which might have inspired him to pose this question. Locke argued that they wouldn’t be able to tell, because vision and touch are different senses, and this has been the subject of much scholarly debate over the past few centuries.
Interestingly enough, we can just test this now! We have developed the ability to restore the sight of those born congenital blind, and in fact, someone has already ran the experiment. The answer is a very loud and resounding, “No”. They actually really suck at it, although obviously, they improved with time.
Now, obviously, these blind children were not academic experts in neurology or in human vision, but this does seem to me to be some evidence towards the ability hypothesis.
Consciousness as self awareness
Some people claim that consciousness is the capacity for introspection. I agree that I am capable of modeling and thinking about myself. If that was all there is to it, I would agree that I am conscious, and that consciousness exists. However, it seems that a lot of people seem to ascribe further phenomenological properties to this, which I am somewhat skeptical about.
Furthermore, what exactly do we mean by self awareness? Is a quine conscious? Is the sentence, “I am this sentence” conscious? Is This Is the Title of This Story, Which Is Also Found Several Times in the Story Itself conscious? Certainly they are self referential, but are they aware? What is the requirement for awareness? These questions seem to circle back again on the idea of qualia, which I don’t know about.
Computational consciousness
There are many schools of thoughts around consciousness. For example, maybe you believe the universe is fundamentally physical, and that consciousness is a physical phenomenon, in which case you would be a physicalist. Perhaps you believe that the universe is fundamentally mental or experiential, in which case you would be an idealist. Perhaps you think, “Eh, why not a bit of both,” in which case you would be a dualist. Now, in the rationalist community, we are primarily physicalists, and a specific popular theory is computational theory of mind, the idea that consciousness arises from computation. I used to be a big proponent of this theory, and it is still my top contender for the source of consciousness, if such a thing does exist.
Against Epiphenomenalism
Epiphenomenalism suggests that mental states are caused by physical states, but don’t have any impact on the physical world whatsoever. This is a very appealing philosophy, because it allows you to believe in consciousness while still being a physicalist, and conveniently you don’t have to think about its impacts on anything, or empirically verify any of your theories about the source of consciousness. However, I unfortunately think it is wrong.
Eliezer Yudkowsky has already critiqued this theory at great length, but in essence, the problem with this is at there is no reason to believe in consciousness. After all, if it can’t impact the physical world, that means any claims I make about being conscious must be completely unrelated to whether or not I actually am conscious. If I were conscious, I would claim to be and act like I am conscious, and if I were not conscious, I would also do that. Now, you could argue that in the first case the belief would be a justified belief, and in the second case it would be an unjustified belief. However I am personally skeptical of the idea that if these two cases cannot be distinguished, you can still have one belief be justified and the other unjustified.
You could also argue that if I am not conscious then nothing matters, and so I might as well act as if I am conscious. This, however, is smuggling in an implicit value system in which I only care about worlds in which I am conscious, which is perhaps true, but it does seem a little strange to me to claim that there is a mysterious phenomenon whose existence or absence thereof cannot be detected, and for whom I might as well act the same way no matter what, but trust me it is definitely an important phenomenon.
Eliezer has some other arguments against epiphenomenalism which are more exhaustive than the ones I’ve listed here, but these are the ones I find most compelling.
Fully Homomorphic Encryption
Recently, I have come across an argument that computational notions of consciousness may be weirder and more unintuitive than one might naively think. The immortal Autumn “adrusi” Russell writes:
I find this to be a very compelling argument. If a homomorphically encrypted system is conscious, then it must be the encrypted computation that is conscious, not the decryption, since decrypting text probably doesn’t produce consciousness. If we accept this argument, it suggests that any computational theory of mind must necessarily be input-agnostic, which I imagine does not mesh well with many people’s intuitions about consciousness.
However, maybe you are willing to bite this bullet, and you believe in a theory of consciousness that is fully input-agnostic, such that your sensory inputs are directly unrelated to your conscious experience. If this is the case for you, please comment, because I would love to hear more about your theories.
There are a few responses you could make to Autumn’s argument, though.
If homomorphically encrypted systems are conscious, then they are conscious only when decrypted. That is, neither the homomorphic computation itself nor the decryption process in isolation produce consciousness, but they produce consciousness when combined. This would be very strange and unintuitive to me, since you could do the homomorphic encryption, wait a hundred years, and then decrypt it then, and it would maybe imply some sort of metaphysical phenomenon tracking which strings were previously produced by homomorphically encrypted conscious systems, but maybe my intuition is wrong. Under this theory, if you do homomorphic computation of a conscious mind and then decrypt it with a completely different key, then presumably(?) you just get the experience of having had a different input
This is also a reasonable stance to take. It does imply that p-zombies are possible, which is a violation of Eliezer’s General Anti-Zombie Principle, but maybe you think that principle is wrong. Personally, I don’t, and it runs into the same problems discussed earlier with epiphenomenalism, since homomorphically encrypted minds would still necessarily believe that they were conscious.
I don’t know if this is actually possible or relevant, but I am including it for the sake of completeness. If anyone has studied this more than I have please tell me in the comments!
Just feel it, man
I’m not really sure to what degree my arguments have been convincing. Perhaps you have fully bought into my arguments for illusionism and no longer believe in consciousness. Perhaps you understand them, and maybe found the FHE argument thought-provoking, but feel like I am missing something fundamental about the nature of experience, but you find it hard to articulate. Maybe you find it very easy to articulate what I am missing, in which case please tell me!
However, I am now forced to face the actual argument that Scott made in his response to me: Most people seem to think that consciousness is a thing that is real! What if I am merely missing out on a core part of the human experience, due to some form of trauma that I may or may not have encountered in my past?[4]
And indeed, meditators around the world, along with
recreational drug usersthe Qualia Research Institute, have all made fascinating claims about their own experiences of consciousness in relation to these activities. One friend of mine claimed to me that they have experienced their consciousness changing in type (in the type theory sense), and being “type punned”. I’m not entirely sure what this is supposed to mean, either from a type theory perspective or from a consciousness perspective, but it was interesting so I thought I would share it.There have been many other fascinating reports from this sphere.[5] This post ostensibly[6] describes what cessation is like. This is another report, describing something similar. Other reports have described feeling on drug trips as if their qualia are being "being outputted into the universe" rather than strictly internal. One friend of mine reported that they have heard of people experiencing cessation of consciousness on ketamine, of the same type as caused by general anesthesia. For some reason, I find that particular report extremely easy to believe.
Surely it’s impossible that people would come up with the concept of consciousness in the first place if it didn’t actually exist, or that billions of people around the world would hear it and agree with it, just because it was claimed to them that it was a thing they had. And as I type this sentence I recognize the absurdity of it, because actually of course they would, and I find that entirely plausible. Human beings are well known for being confused, or bad at philosophy, and so on, and unfortunately all of the evidence I have seen could very well be explained by saying “idk people are kind of crazy”.[7]
But of course, this goes the other way as well. I have no idea whether or not I am simply missing some important experience, such that if I had it, I would automatically believe in consciousness. However, I don’t think this sort of “get out of the car” argument makes for very good epistemology, because it is always indistinguishable from the outside whether or not such an experience actually serves as empirical evidence or merely convinces you in some unempirical way. Additionally, you can always argue that the other person simply didn’t try hard enough. It reminds me a lot of religious people claiming that you just need to “Accept God into your heart”, and that the only reason why people are atheists is because they have not chosen to look at the evidence.
However, I do think Scott’s advice is probably correct, since it seems unlikely that trauma informed therapy could convince me of the existence of consciousness in an unempirical fashion unless the therapist is really bad and I am really stupid, and so it seems worth testing.
The Zombie Preacher of Somerset
I was thankfully able to track down[8] the historical example Scott mentioned in his response to me. It turns out he had already written about it on LessWrong, over a decade ago. I don’t want to repeat his entire post, but I will briefly summarize it here.
Simon Browne was a much-beloved pastor of a church, when one night, he accidentally killed a highway robber. The traumatic nature of this event caused him to become
Unfortunately, reading his testimony does not inspire me with the greatest confidence in his ability to accurately assess his own state of mind. He claimed to have been “damned” and that his soul had been “removed from his body”, which suggests to me that his conception of consciousness was very entangled with his religious identity, and indeed caused by his religious beliefs. I could very easily believe that someone who murdered someone and then described experiencing a severing of their connection to God and morality and feeling like they were damned and soulless was simply experiencing extreme guilt over their ego-dystonic actions, rather than something more phenomenologically fundamental. Thus, I am placing his situation into the “idk people are kind of crazy” bucket.
Final thoughts
What do we know about “consciousness”?
I am, obviously, not skeptical of humans possessing the abilities to take in sensory input. I am also provisionally willing to accept that the strong conviction in being “conscious” reflects some sort of real phenomenon. What I am more skeptical of is the described link between that phenomenon and the things people believe about that phenomenon, just as I believe that people who profess to possess a soul or a spiritual connection to God describe a real experience, while not necessarily believing their claims about that experience.
Of course, it could be the case that I’m entirely wrong about all of this. When possible I will take Scott’s advice and seek out trauma informed therapy, and report back to you with the results.
Possible responses from readers
Yes, yes, I got so incredibly owned.
I would find this unlikely and somewhat surprising, but I suppose it could be true. My friends sometimes joke about this being the case.
You can do whatever you want forever! It’s possible I might object to it, but I’m sure there are ways to get around that.
More seriously, though, I’d like to link to Eliezer’s essay on The Moral Void. If you think that your notions of moral patienthood are inextricably tied to consciousness, whatever it ends up turning to be, then I suppose your moral objections kind of disappear. But if it turns out I’m not conscious, and you end up still caring about my values and about what happens to me, then I suspect your notion of moral patienthood can still be rescued.
Well, I agree that there are some surprising similarities between illusionism and panpsychism, like a bizarre messed up horseshoe theory specifically about theories of consciousness. I’ll be honest here, I just prefer illusionism to panpsychism on an aesthetic level. I suppose my main argument against panpsychism is a burden-of-proof style argument. You’re the one making the claim that consciousness is a concept that meaningfully exists, so you’re responsible for showing that it’s a useful concept, and when your claim is that it’s a mysterious force permeating the entirety of the universe which lies in all things, but doesn’t have any detectable causal impact on the world beyond that described entirely by mundane theories, it starts to sound suspiciously like the arguments of Christian apologetics.
Yeah, this seems like a basically reasonable position to me. I would however be interested in hearing the specific details on what is the minimum computation required for consciousness, and how you respond to the FHE paradox, and if consciousness is a spectrum what components go into that
Could be reasonable! Scott mentioned a paper suggesting that they lacked a specific feedback structure, but it does imply that once they get X they will be conscious, so if you are just really against the idea of LLMs being conscious maybe pick something harder to trivially give LLMs.
But also, like, I’m pretty sure 20 different people have their own competing theories about what specifically it is that distinguishes LLMs from humans, so maybe you should work it out with them?
Yeah this seems very possible to me, but I would argue that if true this is plausibly a flaw in the human condition, and one we should work towards transcending.
…Ok then.
This also happened to me! The earliest memory I can recall is of waking up for the first time on the morning of my third birthday and telling everyone, “Hi! I’m finally conscious!” I also remember for a while after that telling everybody I became conscious when I turned three. This is an incredibly sketchy and suspicious sounding memory, and memories are known to be very unreliable, and also three year olds are known to be kind of crazy and bad at philosophy, so I don’t really put too much weight on this.
I am not a hardline illusionist, and I am very open to the possibility of being wrong. I am currently undecided, and am more of a consciousness skeptic than anything else.
To be clear, I fully believe he did not intend this to be a roast, and it was genuinely a very polite and thoughtful comment. I also think it contains very real and helpful advice. Nevertheless, despite his probable intentions, it was a very epic roast.
I’m not really sure why I picked “snowboarding” as my example here. Amy Kind picked “driving a car”, which is a much more sensible example.
She doesn’t actually say who supports the acquaintance hypothesis or the old fact/new guise analysis, just that “there are proponents”. I know Earl Conee is a strong supporter of the acquaintance hypothesis, but I don’t actually know who is responsible for the old fact/new guise analysis.
Apparently Scott did not misunderstand my question, and that is in fact his stance on illusionism (“I’m increasingly convinced it’s an equivalent of aphantasia”), although maybe he would not describe it as a core part of the human experience even if it might be something that is possible to unlock with therapy. (Thank you to cube_flipper for finding me this)
I put out a request for every friend of mine who is into this kind of thing to tell me their interesting stories. Thank you to everybody who shared!
I unfortunately have a very difficult time in reading and understanding this style of post, but cube flipper whom I trust and admire very much asserts that it is interesting (thank you cube flipper). She also says that I should link to this video
I understand and apologize if you, the consciousness believer, are offended by the assertion that you are kind of crazy, or the later comparison to religious people. I probably think it is more likely that consciousness exists than that any human religion is accurate. (If you, the religious person, are offended, I apologize but I do think your religion is probably false. I don’t think this necessarily reflects poorly upon your moral character or worth as a person or anything though)
Thank you April for pointing me to it!