Machine intelligence will probably be developed first in a big company or government department - by a substantial team. They are going to leave off the big red stop button and be destroyed by their own creation?!? How difficult is it to say: "count to 1000 and then STOP"?!? Some of the smartest minds on the planet build machine intelligence - and then mess up the most basic safety features? It would be an utterly incredible turn of events.