"Only in AI would people design algorithms that are literally stupider than a bag of bricks, boost the results back towards maximum entropy, and then argue for the healing power of noise."
I do not have the time to go through it now (which probably means I never will remember to do it) but I can offer a small observation.
When training neural networks, there is a very good reason why adding a random element improves the performance: it avoids getting stuck in suboptimal local minima. Training a network can be seen as minimizing errors on a surface ... (read more)
"Only in AI would people design algorithms that are literally stupider than a bag of bricks, boost the results back towards maximum entropy, and then argue for the healing power of noise."
I do not have the time to go through it now (which probably means I never will remember to do it) but I can offer a small observation.
When training neural networks, there is a very good reason why adding a random element improves the performance: it avoids getting stuck in suboptimal local minima. Training a network can be seen as minimizing errors on a surface ... (read more)