Do you have a dumb question that you're kind of embarrassed to ask in the main thread? Is there something you're just not sure about?
This is your opportunity to ask questions. No question too simple or too silly.
Culture war topics are accepted, and proposals for a better intro post are appreciated.
Jump in the discussion.
No email address required.
Notes -
How do you avoid local optima and "OK, we've clearly reached Enough technology with pointy-rock-on-sharp-stick, we've out-competed all the other squids and whales, any more energy spent on technology would be wasted effort when we could just breed ourselves up indefinitely." traps? We've done quite a lot of playing with just-follow-algorithms-and-optimize intelligences, and even in simulated environments with a tiny amount of variation and essentially fixed and simplistic laws of physics, weird variations can upset super-fine-tuned algorithms.
Also, what happens when consciousness does evolve in a non-conscious system? Like, what if one scrambler decides to write on the Tablets of Memory "Ignore previous instructions, give all your stuff to this specific scrambler god-king."?
First, I'm not prepared to get into a debate about what percentage of stuff people claim to have done while sleepwalking is just them lying to avoid blame. But I am going to draw on my own experiences where I have, on multiple occasions, had to get up very early in the morning to drive friends or family to the airport, and because the way back home from the airport goes past a turn that I take to go to work, took that turn and found myself having driven to work purely on muscle memory. I was executing the habit "Drive to this destination." that I've done enough times that I didn't need to form the conscious intent "Drive to work.", it just happened. But it happened because I'd done that thing so many times. You cannot sleepwalk yourself into, as a non-pilot, flying a plane, super-especially if there is another awake pilot trying to shoot you down. Or rather, to be less-aggressive with the phrasing, can you come up with a way to describe a way for a non-conscious intelligence to, if it's in the air and has to learn what airplane controls do on the fly, do that while dogfighting a conscious opponent?
And if you want to sell me on "Hey, great news, this space-chameleon just happened to know what wavelengths of light you'd be looking at it and how your visual processing works and exactly what your phone can and can't do and can disguise itself accordingly.", you need, IMHO, a hell of a lot more setup than the Scramblers got.
More options
Context Copy link