site banner

Small-Scale Question Sunday for January 18, 2026

Do you have a dumb question that you're kind of embarrassed to ask in the main thread? Is there something you're just not sure about?

This is your opportunity to ask questions. No question too simple or too silly.

Culture war topics are accepted, and proposals for a better intro post are appreciated.

1
Jump in the discussion.

No email address required.

So, what are you reading?

Still on The Question of Palestine. Said's writing is great as usual, and it is making me want to reread Orientalism. He kinda omitted that the displacement of 1948 was in the context of war, but perhaps he was assuming common knowledge. Interesting facts abound, but the core of the book is the system of thought he's applying, and it remains unclear how useful it is.

Otherwise picking up Al-Ghazali's The Book of Contemplation, book 39 of his Revival of the Religious Sciences series.

Last week I said I was about halfway through Blindsight and didn't really understand the hype, and several people chimed in to second that motion. But about the two-thirds mark, something unexpected happened: it became... good? I'd like to talk about why but don't want to spoiler-tag the entire rest of the comment, so if you have any interest in reading this book, don't read the rest of the comment.

SPOILERS BELOW

The revelation that the aliens can appear invisible to a single individual by synchronising their movements with the individual's saccades, but this tactic doesn't work with groups of people (because their saccades aren't synchronised with each other) was surprising and ingenious. I understand the novel is controversial for its later revelation that, while the aliens are highly technologically advanced, they are not "conscious" as we would understand it, and more than one character goes out of his way to point out how vestigial consciousness is from an evolutionary standpoint, given that humans can perform all manner of highly complex tasks while unconscious (e.g. there have been reports of sleepwalkers getting into their cars and driving without incident). Even the writer who wrote the introduction describes it as an excellent book whose core thesis she vociferously disagrees with.

I'm not entirely sure if Watts's contention is that consciousness is vestigial, an unnecessary evolutionary offshoot the human species would be best served by ridding ourselves of. To be a bit more charitable, the novel could be read as an attempt to demonstrate the concept that consciousness is not a prerequisite for advanced intelligence. I must admit I've never really struggled to decouple the one from the other, but a lot of people seem to find this idea absurd on its face: it's remarkable how many anti-AI arguments boil down to "people say that artificial intelligence is possible, but computers can't be conscious, QED AI is impossible". Blindsight provides us with a vivid example of what a hypothetical non-conscious, non-sapient and yet clearly intelligent species might look like. I wonder if Nick Bostrom was inspired by Blindsight when describing his "Disneyland with no children":

It is conceivable that optimal efficiency would be attained by grouping capabilities in aggregates that roughly match the cognitive architecture of a human mind…But in the absence of any compelling reason for being confident that this so, we must countenance the possibility that human-like cognitive architectures are optimal only within the constraints of human neurology (or not at all). When it becomes possible to build architectures that could not be implemented well on biological neural networks, new design space opens up; and the global optima in this extended space need not resemble familiar types of mentality. Human-like cognitive organizations would then lack a niche in a competitive post-transition economy or ecosystem.

We could thus imagine, as an extreme case, a technologically highly advanced society, containing many complex structures, some of them far more intricate and intelligent than anything that exists on the planet today – a society which nevertheless lacks any type of being that is conscious or whose welfare has moral significance. In a sense, this would be an uninhabited society. It would be a society of economic miracles and technological awesomeness, with nobody there to benefit. A Disneyland with no children.

A thought-provoking novel, even if it takes a long time to get there. I'm not going to donate it to the charity shop just yet.

SPOILERS OVER

I'm about 40 pages into Eric Hoffer's The True Believer. Three years ago I earned an AAQC by arguing that the only people demanding radical ground-up changes to the society in which they live are people who are one or more of poor, unattractive, widely disliked and uncharismatic. How disheartening to learn that Hoffer had scooped me seventy years prior.

I agree that Blindsight was thought-provoking; I just wish its ideas held up to scrutiny.

Spoilers for Blindsight below

According to the conceit of the book, you don't need consciousness to achieve great things and humans aren't special. So, what happens when one (1) human decides "Hey, there's some scary shit out there, let me launch a Von Neumann self-replicating droneswarm that stays synched and fueled with quantum-linked antimatter and blows the shit out of anything it detects fucking with it."?

I feel like the book throws in a lot of completely random setting-building stuff that is just there for vague thematic relevence, and not because it builds a coherent world that explores the ideas therein. In the world of Blindsight, what should happen when humans try to exterminate an ant colony? One is pure, unconstrained instinct, sharpened and honed by millions of years of evolution, with a million eyes and a distributed processing network, with built-in subroutines to handle nearly any kind of obstacle it encounters in its native environment. On the other hand, we have hairless apes...who, because are conscious, can do things like build the civilizational and industrial infrastructure to make and distribute ant poison.

Ah, but what if Satan-Cthulhu was secretly feeding the ants the kind of information that we clearly see needs a conscious mind to extract from the universe, and also the ants could do some weird-ass quantum shit with radiation? Well, for one, the ants would be a really poor thought experiment vector, as I feel the Scramblers are; we have no context for how they think, much less that they do. If the Scramblers are not conscious, why do they respond to torture at all? The story wants me to believe that there is some kind of cosmic Chinese Room of responses that can perfectly pattern-match and encompass the weird-ass protagonists and their dysfunction, such that the Scramblers can somehow arrive at the correct solution to get some random stuff to happen. To me, it just reads like the Scramblers are being fed the author's notes; they don't feel like inhuman superintelligences, they feel like plot devices.

But the thing that did make me realize that the ideas of the book were fundamentally hollow was, ironically, the creepy cool saccade trick. Because, even if we assume that these are actual-Lovecraftian space monsters and literal reality-bending Nyarlathotep is whispering in their space-ears to explain exactly what neurons firing in the squishy human brain-meats that are doing the optical processing...if you have no conception of yourself, and you look at the feed of a creature looking at a room with you in it, how do you know what data has you in it and what doesn't? How do you know how to move to hide yourself if you don't know who or what you are?

I feel like it is kind of the point of the book that the human characters are pretty much weak, helpless, and make consistently bad decisions (when they make decisions at all), but telling a story that cracks apart when one single, solitary character uses judgement and foresight and explores the elements of the setting as they are presented because they have an agenda of Not Dying and take reasonable actions thereof is, to me, not an engaging story.

what if Satan-Cthulhu was secretly feeding the ants the kind of information that we clearly see needs a conscious mind to extract from the universe

I think this begs the question. Why is consciousness a prerequisite for extracting complex information from the universe? Sure, we're the only species that we know of that can extract complex information from the universe, and we're conscious. But this strikes me as a strange kind of parochialism. Nobody thinks that, because we're capable of extracting complex information from the universe and we're featherless bipeds with broad flat nails, therefore the only species capable of extracting complex information from the universe even in principle are featherless bipeds with broad flat nails. People have no trouble imagining an alien species whose bodies look nothing like ours (ever since Lovecraft, squid-like creatures have been standard, for some reason, and Blindsight is no exception to this lineage) and yet which are obviously intelligent. But for some reason, people tend to react with bafflement and ire to the proposal of an intelligent species which isn't conscious as we would understand it. And I genuinely don't know why the one is a prerequisite for the other. I think the word "clearly" in your comment is doing a lot of heavy lifting.

As to how the Scramblers are capable of carrying out complex tasks despite being unconscious, and how this feels to you as if they're just being passed information from the author — well, when I read true stories about sleepwalkers driving cars, I don't take that as evidence for a God who interferes in human affairs, or even that these sleepwalkers have been possessed by an incorporeal spirit. Blindsight's depiction of a species capable of performing complex actions while unconscious isn't just a fictional, hypothetical conceit: we ourselves are an example of just such a species!

On one hand, consciousness isn't directly a prerequisite for purely extracting information; like I said, some sort of weird alien super-MRI could start data-mining human brains. But what happens from there? If a digital sensor that incorrectly starts reading and reporting the noise from its own function is the analogy to consciousness, then the other metaphor is a perfectly-functioning sensor outputting its information to a system that isn't powered on.

We have seen what happens when fine-tuned evolved systems that arose in the purest and deadliest Darwinian competition, optimized and fine-tuned for pure survival; they lose to humans. Maybe not immediately, and maybe not forever, but in our world, neither the largest nor the smallest predator holds dominion when humans decide to claim a space. Instinctive, programmed behavior loses to conscious thought, every time.

I also want to make a distinction between "Do a complex task" and "Outcompete a sentient agent who is turning their sentience against you". The first is easy; we have loads of nonsentient systems that can do really complex and even really adaptive tasks. But, just as it's pretty trivial to adversarially fuck with, e.g., a self-driving system in a car, and it doesn't matter how good the self-driving system is, if you are a person and can, e.g., think in wildly different terms than the self-driving system was made to do. Sleepwalkers can act according to the habits they've built up, but they can't process novel data, and they certainly can't tell when they're being fucked with.

...And, having written that sentence, I think I've just come to my new headcanon; the reason that these five fuck-ups were sent was because the Serious People on Earth recognize that they are dealing with a nonsentient intelligence that was confused by human communication and unable to properly extract the subtext of humans as individual agents, and so sent this ship full of these people to act, honestly and naturally as they would, which is to say, fail at everything that wasn't being micromanaged by Vampire Muppet, in order to poison the Scrambler's training data of what humanity was and was capable of.

But, to get to my general point about that 'clearly'; if you were going to break down the steps involved in doing the sacchade trick, how would you describe it? What information would you need to start with, what can you learn on your first interactions with a novel lifeform, what is your mechanism for sensing the brain bits through increasing and changing layers of anti-radiation shielding, and, most-importantly, why are you doing all this? Lots of nonsentient creatures hide, and some of them do so in really complex ways. But that stealth falls absolutely apart when you are relying on instinct built up from natural selection to hide from creatures you've never met before, with senses you have no information on, whose very cognition is alien to yours, and it falls apart that much faster when those creatures are capable of building tools and devices, and if you as the author aren't cheating and stopping the characters from using fucking periscopes for scouting, then the need to cheat and upload author-derived information directly into the Scramblers becomes even more apparent.


Also, I have to ask: is there a meta-point being made by this post being possibly polished by AI? I mean, you could just be a Mac user, but I see that emdash in there.

I never use AI to compose or "polish" text, and I really resent that accusation being lobbed at me. Once the difference between hyphens and em-dashes was pointed out to me, it became impossible to unsee, and I make a point of using em-dashes whenever they're appropriate. I even asked on this very forum how to type them on a standard keyboard, if you don't believe me.

Apologies, then; the emdash in general is something that I only ever see in AI-derived stuff, plus the actual dash is just right there on the keyboard, plus I do not trust non-basic ASCII to not get mangled when I copy it back and forth. You clearly (again) had enough insight that the ideas were human-derived (and I did actually go to Free ChatGPT and had a kind of uncanny-valley conversation with it to reinforce my intuition that AI was not good at discussing the ideas in Blindsight), and it seemed relevant to a discussion on non-conscious intelligences and what they can and can't do.