site banner

Recursive thinking, Newcomb's problem, and free will

felipec.substack.com

Newcomb's problem splits people 50/50 in two camps, but the interesting thing is that both sides think the answer is obvious, and both sides think the other side is being silly. When I created a video criticizing Veritasium's video This Paradox Splits Smart People 50/50 I received a ton of feedback particularly from the two-box camp and I simply could not convince anyone of why they were wrong.

That lead me to believe there must be some cognitive trap at play: someone must be not seeing something clearly. After a ton of debates, reading the literature, considering similar problems, discussing with LLMs, and just thinking deeply, I believe the core of the problem is recursive thinking.

Some people are fluent in recursivity, and for them certain kind of problems are obvious, but not everyone thinks the same way.

My essay touches Newcomb's problem, but the real focus is on why some people are predisposed to a certain choice, and I contend free will, determinism, and the sense of self, all affect Newcomb's problem and recursivity fluency predisposes certain views, in particular a proper understanding of embedded agency must predispose a particular (correct) choice.

I do not see how any of this is not obvious, but that's part of the problem, because that's likely due to my prior commitments not being the same as the ones of people who pick two-boxes. But I would like to hear if any two-boxer can point out any flaw in my reasoning.

2
Jump in the discussion.

No email address required.

The problem with Newcomb's problem is that it basically involves time travel, and generally underspecifies how that time travel works. Consider a similar problem:

Not time travel, just perfect prediction. If you're actually a perfect predictor then you can in essence see the future. If you had a perfect model of physics and initial conditions then you could predict a coin flip with 100% accuracy. The kind of reason a human does when presented with the boxes is no different unless you a proposing some spooky non-material stuff in the reasoning. The formulation I'm familiar with is perfect prediction in which case there are four theoretical cases.

  1. You one box and Omega correctly predicted you would one box thus you get $1m

  2. You one box and omega incorrectly predicted you would 2 box so you get zero. This is impossible by construction, omega cannot predict wrongly.

  3. You two box and Omega incorrectly assumed you would one box, you get $1m + $1k. This is impossible by construction, Omega cannot be wrong.

  4. You two box and Omega correctly guesses you'll two box. You get $1k.

There are only two actually possible options with the given constraints and you get to make a choice which of them is the case. This is not a paradox unless predicting future events is impossible.

Your whole reasoning relies on there being something intrinsically impossible about predicting your decisions, even as you lay out the reasoning for them. Is it so hard to imagine that someone could read you well enough to know which outcome you'll ultimately reach?

Not time travel, just perfect prediction

Corporate want's you to find the difference between these two pictures and they are the same picture. Either they KNOW the future or they don't, and the problem as typically presented gives us no reason to believe that they do.

This is impossible by construction, omega cannot predict wrongly.

This is only possible if you model people as deterministic mechanisms and not as rational game theory agents. If Newcomb's problem posits that you make a decision AFTER Omega makes a decision, then Omega can be wrong. For instance, if you play a mixed strategy (one box with 50% probability, two box with 50% probability), then omega has to not only model your brain perfectly, but also your coin flip. If you used quantum decay to randomize then it would have to predict that perfectly. If omega can perfectly predict that then you've removed an important tool in Game Theory. It's like trying to argue that Rock Paper Scissors as a paradox because no matter what you do your opponent can predict you and defeat you. If you tell me that I can't do mixed strategies, or that other people can, in the past, respond to my mixed strategy outcomes then that's fundamentally incompatible with 90% of Game Theory. I don't even know what the rules of this are or what the goal is. Omega can do literally whatever it wants and I'll get literally any payoff that it chooses to give me. I suppose if it's a god that wants to punish two boxers then I guess I'll obey its commandments and one box, but that's not adjency, that's not game theory, that's just submitting to the religious edicts of a higher power with arbitrary rules.

We can model it much more simply by making an alternate version where, at time 1, you decide to one box or two box. Then at time 2 omega is informed of your decision and puts stuff in a box, then at time 3 you get the result of the decision you already made. Here you obviously 1 box. This is a very straightforward, simple, and uninteresting game theory problem. The problem with this then is not what the original Newcomb's box says happens. It says you make the decision after omega does. If you actually mean that people make the decision before omega then saying they make it after is lying.

Maybe this is still useful as a critique of attempts to map Game Theory to reality. Essentially saying "Every game is an iterated game played out over the course of your lifetime. Any decisions you make will affect your personality and reputation, so doing greedy things will hurt you in the long term even if they are the rationally correct choice to a one shot game that you see in the short term." Which, sure. This is how cooperation can exist in prisoner's dilemma-like situations, because you cannot incentivize (and it is irrational to try) to cooperate in a true, pure, one-shot prisoner's dilemma with no modifications, but none of those conditions apply in real life. But you also don't have mind-reading omegas in real life either, so I don't think that's quite what people mean by this.

Ultimately, the premises are fundamentally contradictory, so the only way to come to a solution is to suspend disbelief on half of them. Either you believe that omega can perfectly predict you and you have no agency, so hope that your were born as a one-boxer (because you don't get to decide), or you believe you are a rational agent who can make decisions when it says you can, in which case omega can't predict you so might as well two box. But these are beliefs about the premises of the problem, not about what is good epistemic or rational behavior in a given coherent scenario (which always follows logically and mathematically from the premises and math to determine the maximum payoff)