DanArmak comments on Humor: GURPS Friendly AI - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (28)
That looks more like a FAI Critical Success Table.
A FAI Critical Failure would be more along the lines of: all matter in the Hubble volume is converted to computronium simulating a Life game. Roll 6d12 for the seed value of a PRNG that will specify that game's initial state.
Or: the AI self-modifies constantly to adapt to new information. You must pass a FAI skill check each turn, at penalty -15. If you fail the check, the AI's utility function is sign-flipped for that turn. You don't know if you passed each check or not.
(Vaguely D&D terminology, since I'm unfamiliar with GURPS)
The idea, if I parse correctly, is that in order to fail that hard you have to at least know part of what you're doing, and automatic failures are always regular failures (Boom!). However, your implementation failed in some detail somewhere, and now the FAI is being weird. Not necessarily entirely bad, just something unexpected or not-quite-what-we-wanted.
I think the FAI Critical Success Table would look more like:
Roll 1d6.
2 ... 6. (variations on the same theme of ultimate transdimentional / unboxed godhood)