Eliezer_Yudkowsky comments on Teachable Rationality Skills - Less Wrong

52 Post author: Eliezer_Yudkowsky 27 May 2011 09:57PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (257)

You are viewing a single comment's thread. Show more comments above.

Comment author: Eliezer_Yudkowsky 27 May 2011 10:49:19PM 29 points [-]

Skill: Being strategic. I.e., life-consequentialism, where you actually do things based on their expected future consequences, as opposed to drifting into a PhD program because your friends are doing it.

Exercise materials: We either need to develop efficient probes for getting people to list out major life choices that they could actually remake (are under serious reconsideration) or we need to develop hypothetical life stories and policy decisions to use in exercises.

Comment author: Eliezer_Yudkowsky 27 May 2011 10:54:02PM 1 point [-]

Subskill: "What is the consequence, what is the goal?"

Comment author: Eliezer_Yudkowsky 27 May 2011 10:57:58PM 2 points [-]

Exercise A: For some policy that someone is carrying out today, starting as close to the object level as possible (answering an email, making a phone call, buying something at the store), ask about the consequences, and the consequences of the consequences. Identify the consequences that are desirable or that the action is being carried out for-the-sake-of. State the goal in abstract terms. Ask whether achieving the goal has further consequences - even things terminally desirable often have other, instrumentally desirable or undesirable consequences. Trace out the chain of specific events and the abstract instrumental and terminal goals they correspond to.

Exercise B: For each goal node, find some other policy - not necessarily a superior policy, but some other policy - that would be helpful for the same goal, not necessarily in the same way. (The point being to unanchor your concept of that goal from the exact, specific means of achieving it. This also obviously starts on the habit of searching for superior alternatives.)