Vladimir_Nesov comments on How to brainstorm effectively - Less Wrong

43 Post author: PECOS-9 19 May 2012 09:29PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (26)

You are viewing a single comment's thread.

Comment author: Vladimir_Nesov 19 May 2012 10:04:07PM 17 points [-]

This calls for a link to simulated annealing, an optimization heuristic. Here, initial sampling is "provocation" and the jumps later in the process of cooling are "movement".

Comment author: shokwave 20 May 2012 03:40:55AM 7 points [-]

It shouldn't be so surprising to me, seeing simulated annealing in so many places. It's a good approximation for optimising NP problems, it should develop organically in places dealing with NP problems.

Comment author: hankx7787 20 May 2012 12:41:20PM 0 points [-]

incredible comment. that was very insightful, thanks

Comment author: [deleted] 21 May 2012 07:26:10PM 0 points [-]

How do you set your prior for initial sampling? This seems like the fundamental problem to me (with regards to creativity). Suppose I want to brainstorm about a scientific problem. I don't want to start with "cars have square wheels" because that has nothing to do with my problem. But, if I start with a statement of the problem, I have already "primed" myself in a certain direction, even if I just negate the problem statement. I guess the analogy breaks down a little. For SA, I would use a uniform prior, and I'm guaranteed eventually to explore every part of the space. Idea space is too big for that. On the other hand, the trade-off is similar: more random starting points that are random, or fewer random starting points using a better prior.

Comment author: PECOS-9 21 May 2012 07:52:37PM 1 point [-]

Isn't that the purpose of the 5 provocation techniques? You pick a few statements which are taken for granted related to the area of the problem, and then reverse/negate/distort them in some way. This isn't a uniform distribution over idea space, since the taken-for-granted statements are related to the problem area.

Comment author: roll 20 May 2012 08:35:15AM *  0 points [-]

This raises interesting off-topic question: does 'intelligence' itself confer significant advantage over such methods (which can certainly be implemented without anything resembling agent's real world utility)?

We are transitioning to being bottlenecked (in our technological progress, at least) by optimization software implementing such methods, rather than being bottlenecked by our intelligence (that is in part how the exponential growth is sustained despite constant human intelligence); if the AI can't do a whole lot better than our brainstorming, it probably won't have upper hand over dedicated optimization software.