Does there exist a paper version of Yudkowsky's book "Rationality: From AI to Zombies"? I only found a Kindle version but I would like to give it as a present to someone who is more likely to read a dead-tree version.
I am not sure of myself, here, but I would expect a malicious AI to do the following. The first few (or many) times you run it, tell you the optimal stock. Then once in a while give a non-optimal stock. You would be unable to determine whether the AI was simply not turned on those times, or was not quite intelligent/resourceful enough to find the right stock. It may be that you would want the profits to continue.
By allowing itself to give you non-optimal stocks (but still making you rich), the AI can transmit information, such as its location, to anyone who would be looking at your pattern of buying stocks. And people would look at it, since you would be consistently buying the most profitable stock, with few exceptions. Once the location of the AI is known, you are in trouble, and someone less scrupulous than you may get their hand on the AI. Humans are dead in a fortnight.
Admittedly, this is a somewhat far-fetched scenario, but I believe that it indicates that you should not ask the AI more than one (or a few) questions before permanently destroying it. Even deleting all of its data and running the code again from scratch may be dangerous if the AI is able to determine how many times it has been launched in the past.
Subscribe to RSS Feed
= f037147d6e6c911a85753b9abdedda8d)
(Note: this is not actually true. But Good and Real recapitulates most of the points you'll see in the philosophy-related sequences, with less focus on the basics and more on elaborating philosophical arguments. If this is the content you want to share, it might be a good choice.)
Thank you.