site banner

Recursive thinking, Newcomb's problem, and free will

felipec.substack.com

Newcomb's problem splits people 50/50 in two camps, but the interesting thing is that both sides think the answer is obvious, and both sides think the other side is being silly. When I created a video criticizing Veritasium's video This Paradox Splits Smart People 50/50 I received a ton of feedback particularly from the two-box camp and I simply could not convince anyone of why they were wrong.

That lead me to believe there must be some cognitive trap at play: someone must be not seeing something clearly. After a ton of debates, reading the literature, considering similar problems, discussing with LLMs, and just thinking deeply, I believe the core of the problem is recursive thinking.

Some people are fluent in recursivity, and for them certain kind of problems are obvious, but not everyone thinks the same way.

My essay touches Newcomb's problem, but the real focus is on why some people are predisposed to a certain choice, and I contend free will, determinism, and the sense of self, all affect Newcomb's problem and recursivity fluency predisposes certain views, in particular a proper understanding of embedded agency must predispose a particular (correct) choice.

I do not see how any of this is not obvious, but that's part of the problem, because that's likely due to my prior commitments not being the same as the ones of people who pick two-boxes. But I would like to hear if any two-boxer can point out any flaw in my reasoning.

3
Jump in the discussion.

No email address required.

Think of a fully clockwork universe, down to the apparently random quantum phenomena. IFF you have the full picture, can see the entanglement at the big bang, can calculate out the impossibly complex gear movements, you can know what a 'random' quantum event is going to be. But from the limited perspective, inside a finite light cone, you cannot. The initial entanglement is invisible, some of the gears are hidden. This doesn't make it not clockwork, it just means you don't have access and so quantum randomness is the best you can do.

We have the same thing here - from our perspective, lacking whatever it is that gives Omega the accuracy, whatever lets it see the gears we can't, our choice looks free and the answer uncorrelated. It is correlated, which is why Omega can be as accurate as it is, but we can't see the same thing. So ordinarily, we use our game theory and our strict domination and it works out fine. But here, we have a cheat. The problem has given us information we otherwise wouldn't have access to - we now know there is, in fact, a correlation between our 'future' choice and the contents of the box now. We don't know how it works, we don't know why it works, but we have been given that information. We can cheat the problem by leveraging that information. That's why one boxing is rational. That's why ordinary game theory goes away. We have something stronger to use in our thinking.

you don't have access

I don't follow. Every part of you that is necessary to follow the clockwork has appropriate access to the mechanisms of the clock, at least to the extent that is necessary for it to be able to follow the clockwork. If there were some part of you that didn't have such access, then it wouldn't be able to follow the clockwork, and we would reach a contradiction.

Like, maybe try to explain how this works directly on the example of analyzing an actual clock, with determined suboptimal action y' and a hypothesized optimal action y. What doesn't have access to what?

You have access to the gears that drive you (up to your particle horizon anyway, you can't necessarily see the whole train of gears leading to you because your lightcone is finite and smaller than the universe as a whole), but that doesn't mean you have access to the gears that drive everything else. Deterministic clockwork does not imply information or light propagation need be any faster than the traditional limit.