drethelin comments on Open Thread for February 18-24 2014 - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (454)
I found a watch upon the heath.
Anyway, I think there are enough instrumental goals that even without human-like goals we should be able to recognize crafted tools like watches, hammers, and whatnot.
How do you know the hammer is crafted while the hammer fish isn't?
well one of them is alive and moves around on its own. A hammer is a technological artifact with no visible or even implied means of existing without being crafted. You can't observe baby hammers crafting each other out of raw material in nature.
That's pattern-matching to humanity, something I explicitly asked not to rely upon. Unless you can show that instrumental goal convergence is inevitable and independent from terminal goal or value convergence. Can you?
I'm having trouble imagining what these terminal goals are that can be optimized toward without having at least some familiar instrumental goals such as timekeeping, attaching things to other things, or murdering entities. Can you give me some examples?