LW and related blogs are basically spoiling fantasy fiction to me. DAE have an experience like this? How to overcome it?
That which can be destroyed by the truth...
Am I no the first one to notice the all-improving Philosopher's Stone could not exist in principle because improvement is a mental category and not real, right?
To some extent the "value aligned agents" problem, formerly known as "friendly AI," boils down to "how would we actually check our 'improvement-map' for validity and create agents that will actually enforce that improvement-map on reality, rather than something else?"
If it's worth saying, but not worth its own post (even in Discussion), then it goes here.
Notes for future OT posters:
1. Please add the 'open_thread' tag.
2. Check if there is an active Open Thread before posting a new one. (Immediately before; refresh the list-of-threads page before posting.)
3. Open Threads should be posted in Discussion, and not Main.
4. Open Threads should start on Monday, and end on Sunday.