Let's compare two theories. One is Newton's gravity, the other Luminiferous Aether. When Einstein's theory of relativity arrived, Newton's Gravity turned to be a subset of it, an approximation that works under specific conditions.

On the other hand, Luminiferous Aether is just plain wrong.

Now, imagine that a scientist in the era before Theory of Relativity built a Strong AI (just roll with me here :-) ) and tasked it with finding out why Newton's Gravity doesn't work quite right around Mercury. The AI derived the Theory of Relativity.

Now, imagine this scientist asking the AI what Luminiferous Aether is made from. The AI is going to throw an OutOfLuminiferousAether exception (don't ask me why the AI is written in Java).

Humorous prelude aside, I am wondering which concepts we have today are only slightly wrong, and which are completely wrong? I am asking mostly about the concepts that are discussed on this forum.

Obviously, the more abstract is the concept, the more risk there that it will turn out to be bunkum.

Personally, I don't trust the concept of values. It's already so complex and fragile, I'm afraid it doesn't actually exist.

Reading a Reddit thread about the experiences of people who woke up after a long coma, got me thinking. If something similar happens to me, I might wake up with a significant portion of my memories gone (not to mention changes of personality). The question is, how do I make sure that the amnesiac future-me will continue to pursue the goals of present-me?

This can be divided into 3 sub-questions:

1. How to determine what goals are worth transmitting to my future-self?
2. How to actually transmit those goals?
3. How to persuade future-self that the goals are worth pursuing?

Any suggestions?

PS. You may ask, why am I focusing on goals? I'll just let agent Smith speak for me.

Serious question. No single human being can build a nuclear reactor, land on the moon or calculate pi to the billionth digit, but humanity can. Does it qualify?

Excuse the horrible terribad pun...

An evil Omega has locked you in a box. Inside, there is a bomb and a button. Omega informs you that in an hour the bomb will explode, unless you do the opposite of what Omega predicted you will do. Namely, press the button if it predicted you won't or vice versa. In that case, the bomb won't explode and the box will open, letting you free.

Your actions?

PS. You have no chance to survive make your time.

PPS. Quick! Omega predicted that in exactly 5 second from now, you will blink. Your actions?

PPPS. Omega vs. Quantum Weather Butterfly. The battle of the Eon!

Leaving aside the essentially Calvinist nature of Extropian techno-theology exposed herein (thou canst be punished in the afterlife for not devoting thine every waking moment to fighting for God, thou miserable slacking sinner), it amuses me that these folks actually presume that we'd cop the blame for it—much less that they seem to be in a tizzy over the mere idea that spreading this meme could be tantamount to a crime against humanity (because it DOOMS EVERYONE who is aware of it).

Enjoy.