All of Erik2's Comments + Replies

The Wonder of Evolution

"Only in AI would people design algorithms that are literally stupider than a bag of bricks, boost the results back towards maximum entropy, and then argue for the healing power of noise."

I do not have the time to go through it now (which probably means I never will remember to do it) but I can offer a small observation.

When training neural networks, there is a very good reason why adding a random element improves the performance: it avoids getting stuck in suboptimal local minima. Training a network can be seen as minimizing errors on a surface ... (read more)