Lumifer comments on Siren worlds and the perils of over-optimised search - Less Wrong

27 Post author: Stuart_Armstrong 07 April 2014 11:00AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (411)

You are viewing a single comment's thread. Show more comments above.

Comment author: Stuart_Armstrong 07 April 2014 05:33:20PM 2 points [-]

It's not an issue of proportion, but of whether there will be a single representative of the class in the worlds we search through. We want a fraction of the space such that there is an acceptable world in it with high probability, and no siren/marketing world, with high probability.

Eg if 1/10^100 worlds is acceptable and 1/10^120 worlds is siren/marketing, we might want to search randomly through 10^101 or 10^102 worlds.

Comment author: Lumifer 07 April 2014 05:42:59PM 4 points [-]

Looks like you're basically arguing for the first-past-the-post search -- just take the first world that you see which passes the criteria.

Comment author: Stuart_Armstrong 07 April 2014 05:48:54PM 3 points [-]

Yep, that works better than what I was thinking, in fact.