drethelin comments on Open Thread for February 18-24 2014 - Less Wrong

4 Post author: eggman 19 February 2014 12:57PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (454)

You are viewing a single comment's thread. Show more comments above.

Comment author: drethelin 20 February 2014 10:04:57PM 0 points [-]

I found a watch upon the heath.

Anyway, I think there are enough instrumental goals that even without human-like goals we should be able to recognize crafted tools like watches, hammers, and whatnot.

Comment author: ChristianKl 24 February 2014 08:54:27AM 1 point [-]

How do you know the hammer is crafted while the hammer fish isn't?

Comment author: drethelin 24 February 2014 08:57:50PM 0 points [-]

well one of them is alive and moves around on its own. A hammer is a technological artifact with no visible or even implied means of existing without being crafted. You can't observe baby hammers crafting each other out of raw material in nature.

Comment author: shminux 20 February 2014 10:12:08PM *  0 points [-]

That's pattern-matching to humanity, something I explicitly asked not to rely upon. Unless you can show that instrumental goal convergence is inevitable and independent from terminal goal or value convergence. Can you?

Comment author: drethelin 21 February 2014 12:47:06AM 0 points [-]

I'm having trouble imagining what these terminal goals are that can be optimized toward without having at least some familiar instrumental goals such as timekeeping, attaching things to other things, or murdering entities. Can you give me some examples?