Emile comments on Dragon Ball's Hyperbolic Time Chamber - Less Wrong

35 Post author: gwern 02 September 2012 11:49PM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (62)

You are viewing a single comment's thread.

Comment author: Emile 03 September 2012 07:48:15AM 3 points [-]

The reason I expect uploads to have a big impact is not particularly accelerated time - it's the ability to copy, observe and modify the uploads.

If I was an upload with access to my own source code (or access to my data and the source of the software on which I'm running, etc.), I might want to try to run modified versions of myself to see what changes, to see if I can have better short-term memory, or if I can "outsource" any maths calculation to more optimized software, or have introspective access to my emotional reactions or the reasons I believe things, or have better/different senses (directly perceive and modify code and data?), or decrease my learning time, etc.

Comment author: GeraldMonroe 03 September 2012 05:59:59PM *  3 points [-]

What stops you from making a change that is addictive or self-amplifying? For example, suppose a subtle tweak makes you less averse to making another subtle tweak in the same direction. A few thousand iterations later and your network is trashed. http://lesswrong.com/lw/ase/schelling_fences_on_slippery_slopes/

It seems to me that the only safe way to do this would be to only permit other uploaded entities to make the edits, working in teams, with careful observation and testing of results. Older versions of yourself might be team members.

Also, the hardware design would need to be extremely well thought out, so that it is not possible for someone to Blue Pill attack you without your knowledge, or directly overwrite your neural structures with someone else's patterns. The hardware would have to be designed with security permissions inherently baked in : here's a blog post where Drexler discusses this :

http://metamodern.com/2011/08/03/quiz-question-what-is-wrong-with-this-model-of-computation/