I used the word "cut" in the title to mean the Prolog operator "cut", an operator which halts the evaluation of a statement in predicate logic.
Fiction writers often complain, "I keep procrastinating from writing," and, "Nobody reads what I write." These complaints are usually the result of shoulds stopping them from thinking about their wants.
I've never heard anyone say, "I keep putting off playing baseball," or, "I keep putting off eating ice cream." People who keep putting off writing don't want to write, they want to have written. If you have to try to write more often than you have to try not to write, you've probably told yourself that you should write in order to attain some reward. There's nothing wrong with that, but writers who complain that they keep putting off writing are often writing things with little potential payoff, like fan-fiction. They don't stop and think how to improve the payoff that they want, because they get stuck on the should that they've cached in their heads.
I've repeatedly tried to help writers who complain that not enough people read what they write. I explain that if you want to be read by a lot of people, you need to write something that a lot of people want to read. This seems obvious to me, but I'm always immediately attacked by indignant writers saying that they want to write great fiction, and that one should write only to please oneself in order to write great fiction. Sometimes these are the same people who complained that they want more people to read what they write.
Why does their desire to write great fiction take complete precedence over their desire to have readers? Because they have cached that desire as a should. (They haven't cached a should for their goal to get more readers because that goal arose much later, after they had already learned to write well and discovered, to their horror, that just writing well doesn't bring you readers.) For a moral agent, shoulds trump wants, by definition.
I've explained before that I don't think there is any deep difference between wants and shoulds. The English language doesn't pretend there is; we say "I should do X" both to mean "I have a moral obligation to do X" and "I need to do X to satisfy my goals." The problem is that most people think there is a difference, and that shoulds are more important. They have a want, they figure out what they need to do to satisfy it, they think aloud to themselves that they should do it, and boom, they have lexically convinced themselves that they have a moral obligation to do it.
Seems to me that you only consider wants and shoulds as relevant parts of the story, but what about urges? People are sometimes driven by forces they did not anticipate.
As an example -- I want to see what is new on LessWrong today, which would literally take 15 minutes at most. So I open the page in the browser, because those 15 minutes seem worth the pleasure I get from reading LW. This part was my conscious decision.
However there a few hyperlinks in the articles, other hyperlinks in the comment, my curiosity overpowers me to open them; some of them lead to wiki pages which are like crack for internet addicts. I also want to write some comment on LW and realize "there was one LW article really relevant to what I am trying to express, I should find it and hyperlink it", but then I find myself reading those other articles... and suddenly I realize that I am already 4 hours online, which means my whole evening today is over.
Now here is a conflict between my conscious wish to spend 15 minutes online and the reality of spending 4 hours online. My behavior was motivated by urges triggered by things that only happened after I started reading. If I were a perfectly rational being, I would have anticipated them based on my previous experience, and told myself "really, the choice is between no LessWrong, and on average 4 hours online; you don't realistically have a third choice here"; and there perhaps I could choose to read LessWrong only once in a week. Or if I had a software filter that would remove all hyperlinks to non-LW pages, and preferably even censor all comments containing them to avoid temptation, I would probably use it. Again, being more instrumentally rational, I would probably write such filter for myself, or pay someone else to do it; but at this moment, I don't have it.
So if my original plan for the evening is to read LW for 15 minutes and then play a computer game for 3 hours, but then I really spend 4 hours online, then I procrastinate playing a computer game. Yes, it happens. In the same way I also procrastinate watching movies.
So I think this article is confusing a different meanings of the words want ("feel an immediate urge" and "coherent extrapolation of near-mode conscious decisions") and should ("have a far-mode scenario about oneself", "have a biased conclusion about oneself triggered by conflicts between far-mode scenarios and near-mode observations").
Also, the situation does not have to "either -- or". I can procrastinate on writing my blog both because I would greatly enjoy having it written, but I enjoy actually writing it significantly less; and because my urges overcome my original conscious decisions and make me spend the whole evening online instead of writing the article, even if at the end I feel bad about wasting the evening online, and would have enjoyed somehow the writing of the article instead. Or that sometimes it is difficult to start writing a blog article, but then it is pleasant to continue writing it.
If that were at work here, we'd see the near-mode urges (I think that's "have more readers" in the example) taking priority over the far-mode goal (write great fiction). We see the opposite. Urges may be a different category and need different treatment, but I don't think they apply in this example, which is about a very analytic activity where everything is in far mode.