Eliezer_Yudkowsky comments on Teachable Rationality Skills - Less Wrong

52 Post author: Eliezer_Yudkowsky 27 May 2011 09:57PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (257)

Sort By: Popular

You are viewing a single comment's thread. Show more comments above.

Comment author: Eliezer_Yudkowsky 27 May 2011 10:54:02PM 1 point [-]

Subskill: "What is the consequence, what is the goal?"

Comment author: Eliezer_Yudkowsky 27 May 2011 10:57:58PM 2 points [-]

Exercise A: For some policy that someone is carrying out today, starting as close to the object level as possible (answering an email, making a phone call, buying something at the store), ask about the consequences, and the consequences of the consequences. Identify the consequences that are desirable or that the action is being carried out for-the-sake-of. State the goal in abstract terms. Ask whether achieving the goal has further consequences - even things terminally desirable often have other, instrumentally desirable or undesirable consequences. Trace out the chain of specific events and the abstract instrumental and terminal goals they correspond to.

Exercise B: For each goal node, find some other policy - not necessarily a superior policy, but some other policy - that would be helpful for the same goal, not necessarily in the same way. (The point being to unanchor your concept of that goal from the exact, specific means of achieving it. This also obviously starts on the habit of searching for superior alternatives.)