The September Open Thread, Part 2 has got nearly 800 posts, so let's have a little breathing room.
This thread is for the discussion of Less Wrong topics that have not appeared in recent posts. If a discussion gets unwieldy, celebrate by turning it into a top-level post.
That's terrifying in the context of get-it-right-the-first-time AI.
I hope there will be some discussion of why people think it's possible to get around that sort of unknown unknown, or at best, barely niggling on the edge of consciousness unknown.