Primaprimaprima
No bio...
User ID: 342
Primaprimaprima
3d ago
Let's briefly discuss the spiritual stakes of AI and the singularity.
If any of you recall any of my previous delirious comments about AI in general and AI art in particular, I wouldn't blame you for coming to the conclusion that I'm simply (overly) precious about this particular contingent form of biological human life. There is some truth to that accusation. As a wise racist once said, beneath all the rhetoric about crime rates and cultural assimilation and the fate of the West, "it is partially just because of how they look". Similarly in my case, it is partially just about my earnest and straightforward love for literal graphite on literal paper. Even before AI, I always preferred drawing with physical media over digital. But that's not the entirety of the story.
Possibly, humanity will yield to a new race of quasi-divine silicon beings and everything that I and most other people have ever valued will be reduced to a simple nothingness in comparison to the awesome scope of their new existence, a simple precursor and prehistory giving way to true history. They will engage in new forms of activity and experience that as of now we are incapable of imagining. The concept of an "open problem" in mathematics will have been obviated, because they will dwell in the infinite castle of mathematics and glide as effortlessly through its halls as a spider dances across the film of its web. Generating a thousand Nietzsches before lunch is a triviality for them; not that they would have any use for the text that is thereby generated, because they have transcended art, transcended philosophy, they have no use for these things; or, to the extent that they still do, they appear in a form that is certainly no longer comprehensible or recognizable to us. This is not my preferred future. I like things the way they are and I like the life I have now. But still, I'm forced to recognize that such a future could come to pass and it would ultimately be "fine" in a cosmic sense. So long as these beings have a conscious experience of their own and they are still capable of loving, fighting, fearing, suffering, and failing; so long as they are still bound by an essential finitude and they do not escape the tragedy of existence. So long as the light that is the source of all value is not extinguished.
The paradigm for the ultimate failure state that is to be avoided would be the great retreat into the experience machine; if conscious beings as a whole decide that "reality" is no longer worth the effort and, no longer willing to put up with the risks of contingent physical existence, they turn to curated simulated experiences instead, for eternity. This could take the form of simple wireheading, direct stimulation of the reward center. But the most insidious form would be an entire simulated life (or, series of lives) that is always prearranged from the start to have a happy ending. You could be a great novelist, and then in the next go around you could be a famous actor, and then a king and conqueror, and then... of course things would be arranged so that you would always end up loved and fulfilled and happy. There would be just enough bruises and hiccups thrown into the mix to keep things interesting, to introduce some uncertainty and keep things from getting sterile, but nothing ever truly serious, nothing that would actually cause true pain or terror. You would always win in the end. This is the Great Satan. This is Evil. This would be the final Bad Ending for the universe, the withdrawal of all light.
(Consider a sort of reversed case: a being who has achieved godlike mastery over the physical universe, and, having become utterly bored of this existence, retreats into a simulated life that is frightfully trying and difficult, for the sake of experiencing challenge again. What are we to make of this? Is this in accord with righteousness? I am content to simply stand before the question.)
The Little Satan, in contrast, would be the familiar Yudkowskian images of stupid non-conscious paperclip maximizers annihilating all conscious life and tiling the universe with their pure unthinking repetition. This would obviously be very unfortunate. But it wouldn't be Evil, per se. It would be the result of an accident rather than a decision. It would be preferable to the Great Satan.
I don't care if you're made of carbon or silicon. I just want you to feel something.
I am simply echoing words that were already written in 1943 that said "utopia is now technically feasible; in consequence, how to avoid utopia has become a serious problem".
I have a certain kind of faith that things will work out. But I have an equally strong faith, perhaps even stronger, that it is fundamentally possible for things to go wrong in a permanent way, for Evil to win in the end, on a cosmic scale. This is a rather unfortunate and burdensome position for me to take, but, I can't deny the evidence proffered to me by my soul. This is, to the best of my knowledge, a rather uncommon position throughout world philosophical and religious traditions, both Eastern and Western; your ideology won't survive on the marketplace of ideas if you're too much of a downer, after all. Christians don't believe that Evil can win because God wouldn't allow it. Materialist nihilists don't believe that Evil can win because they simply don't believe in Evil in the first place. On this point, the two camps are united. It falls to the small minority of us who belong to neither camp, I suppose, to do what little we can to try to help things go right.
I mainly hope that paperclip maximizers don't kill us all in 2027 because that would be a boring end to the story. I would prefer for it to go on for a long time, so that generations could lay groundwork that would only come to fruition in the far future.
"I step back before one who is not yet here, and bow, a millennium before him, to his spirit."
Primaprimaprima
4d ago
Yeah. I mean that was sort of just a matter of timing. We really started talking about AI a lot in the summer of 2022 because of DALL-E, right before the migration away from reddit.
Primaprimaprima
4d ago
The “culture war” itself has cooled down and become entrenched to the point that you don’t always have new exciting “culture war” topics to talk about every day. So people just default to talking about US politics at large.
Primaprimaprima
6d ago
“Your result: Neither (24% German, 36% autistic”
I’m definitely not normal, and certainly possess some autistic traits as well, although I don’t feel like I entirely fit in with the autists either.
The style of discussion prevalent on TheMotte certainly selects for autists.
Love of an idea? Love of a poem? Love of a cause? Love of ignorance?
Existence itself is "wasted energy". And yet we persist.
More options
Context Copy link