Roger Dearnaley

It is commonly asserted that aligning AI is extremely hard because 1. human values are complex: they have a high Kolmogorov complexity, and 2. they're fragile: if you get them even a tiny bit wrong, the result is useless, or worse than useless. If these statements are both true, then...

Multi-Armed Bandits Considered Harmful People frequently analyze the process of artificial agents gathering knowledge in the framework of explore/exploit strategies for multi-armed bandits. However, a multi-armed bandit is a simplistic black-box abstraction – the possible rewards from pulling each arm have no underlying logic: by definition they’re unknown and unknowable...