You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

Thinking well

28 Vaniver 01 April 2015 10:03PM

Many people want to know how to live well. Part of living well is thinking well, because if one thinks the wrong thoughts it is hard to do the right things to get the best ends.

We think a lot about how to think well, and one of the first things we thought about was how to not think well. Bad ways of thinking repeat in ways we can see coming, because we have looked at how people think and know more now about that than we used to.

But even if we know how other people think bad thoughts, that is not enough. We need to both accept that we can have bad ways of thinking and figure out how to have good ways of thinking instead.

The first is very hard on the heart, but is why we call this place "Less Wrong." If we had called it something like more right, it could have been about how we're more right than other people instead of more right than our past selves.

The second is very hard on the head. It is not just enough to study the bad ways of thinking and turn them around. There are many ways to be wrong, but only a few ways to be right. If you turn left all the way around, it will point right, but we want it to point up.

The heart of our approach has a few parts:

 

  1. We are okay with not knowing. Only once we know we don't know can we look. 
  2. We are okay with having been wrong. If we have wrong thoughts, the only way to have right thoughts is to let the wrong ones go. 
  3. We are quick to change our minds. We look at what is when we get the chance. 
  4. We are okay with the truth. Instead of trying to force it to be what we thought it was, we let it be what it is. 
  5. We talk with each other about the truth of everything. If one of us is wrong, we want the others to help them become less wrong. 
  6. We look at the world. We look at both the time before now and the time after now, because many ideas are only true if they agree with the time after now, and we can make changes to check those ideas. 
  7. We like when ideas are as simple as possible. 
  8. We make plans around being wrong. We look into the dark and ask what the world would look like if we were wrong, instead of just what the world would look like if we were right. 
  9. We understand that as we become less wrong, we see more things wrong. We try to fix all the wrong things, because as soon as we accept that something will always be wrong we can not move past that thing. 
  10. We try to be as close to the truth as possible. 
  11. We study as many things as we can. There is only one world, and to look at a part tells you a little about all the other parts. 
  12. We have a reason to do what we do. We do these things only because they help us, not because they are their own reason.

 

A concise version of “Twelve Virtues of Rationality”, with Anki deck

3 [deleted] 12 September 2013 02:38AM

In an effort to internalise the Twelve Virtues of Rationality, I created an Anki deck. It's already been done, so the reason I'm posting is to share a condensed version of the article (created as a side effect of my making the deck).

Hopefully it will make it easier to quickly refresh the concepts if you've already read the article.

If you're not using spaced repetition, you should. Don't believe me? Try reading Gwern's thorough review of the topic.

Then download the “Twelve Virtues of Rationality” deck.



The twelve virtues of rationality: Curiosity, relinquishment, lightness, evenness, argument, empiricism, simplicity, humility, perfectionism, precision, scholarship, and the void.

The first virtue is curiosity.

Curiosity seeks to annihilate itself; there is no curiosity that does not want an answer.

A burning itch to know is higher than a solemn vow to pursue truth.

To feel the burning itch of curiosity requires both that you be ignorant, and that you desire to relinquish your ignorance.

The second virtue is relinquishment.

P. C. Hodgell said: “That which can be destroyed by the truth should be.”

If the iron approaches your face, and you believe it is hot, and it is cool, the Way opposes your fear.

Evaluate your beliefs first and then arrive at your emotions.

The third virtue is lightness.

Surrender to the truth as quickly as you can.

If you regard evidence as a constraint and seek to free yourself, you sell yourself into the chains of your whims.

The fourth virtue is evenness.

Beware lest you place huge burdens of proof only on propositions you dislike, and then defend yourself by saying: “But it is good to be skeptical.”  

Do not seek to argue for one side or another, for if you knew your destination, you would already be there.

To be clever in argument is not rationality but rationalization.

The fifth virtue is argument. 

Those who smile wisely and say: “I will not argue” remove themselves from help, and withdraw from the communal effort.

The part of yourself that distorts what you say to others also distorts your own thoughts.

Seek a test that lets reality judge between you.

The sixth virtue is empiricism.

The roots of knowledge are in observation and its fruit is prediction.

Do not ask which beliefs to profess, but which experiences to anticipate.

The seventh virtue is simplicity. 

When you profess a huge belief with many details, each additional detail is another chance for the belief to be wrong.

In mathematics a mountain of good deeds cannot atone for a single sin. Therefore, be careful on every step.

The eighth virtue is humility.

To be humble is to take specific actions in anticipation of your own errors.

It is useless to be superior: Life is not graded on a curve. 

The best physicist in ancient Greece could not calculate the path of a falling apple.


The ninth virtue is perfectionism.

The more errors you correct in yourself, the more you notice.

If you tolerate the error rather than correcting it, you will not advance to the next level and you will not gain the skill to notice new errors.

Do not be content with the answer that is almost right; seek one that is exactly right.

The tenth virtue is precision.

What is true of one apple may not be true of another apple; thus more can be said about a single apple than about all the apples in the world.

The narrowest statements slice deepest.

Do not walk to the truth, but dance. On each and every step of that dance your foot comes down in exactly the right spot.

The eleventh virtue is scholarship.

Study many sciences and absorb their power as your own.

If you swallow enough sciences the gaps between them will diminish and your knowledge will become a unified whole. 

The Art must have a purpose other than itself, or it collapses into infinite recursion.

Before these eleven virtues is a virtue which is nameless.

Miyamoto Musashi wrote, in The Book of Five Rings:  “The primary thing when you take a sword in your hands is your intention to cut the enemy.”

Every step of your reasoning must cut through to the correct answer in the same movement.

Do not ask whether it is “the Way” to do this or that. Ask whether the sky is blue or green.

All techniques are one technique.


The twelve virtues of rationality: Curiosity, relinquishment, lightness, evenness, argument, empiricism, simplicity, humility, perfectionism, precision, scholarship, and the void.




If I've made any mistakes or omissions, please speak up!



Gameplay Art

1 ac3raven 19 September 2011 09:30PM

This post is about the development of our game based on Eliezer Yudkowsky's "The Twelve Virtues of Rationality".

Are games art?

It's an interesting question, but it seems that most people who answer that question in the affirmative are--intentionally or not--subscribing to the "hybrid art" view.  That is, that games are art because they combine story-telling, music, and visual style; interaction with the system of the game is in service to the storyline, music, and visual style.

I don't like that.  Here is why:

"Art" in general is creative expression through a medium. The hybrid-art view treats gameplay as the icing on the narrative-musical-visual cake.  When it should be that gameplay is the cake, and everything else is the icing.

Gameplay, or interaction with the system of the game, is a  medium for artistic expression, just like paint is for paintings.  I don't think anyone can deny that interaction with a gun during a hostile situation reeks havoc on our emotions, or that interaction with a loved one can run the emotional gamut.  Interaction is powerful.

Games can take advantage of the power of interaction to be expressive.  The art of the storyline, music, and visuals ought to be secondary to the art of the gameplay.

Twelve Virtues

I believe that gameplay is a very powerful way to learn, and so the single most important design principle for our current project is expression through gameplay.  We want to convey the meaning of each virtue through gameplay. The player should be able examine the method by which they interact with the game to learn the meaning behind the virtue.

For example:

Point of no return

In our Curiosity level which is where the game starts, the player must follow a mysterious cat that appears.  Very early in the level, the player is faced with a "point of no return".  If they jump down to the ground, they can't ever go back to the starting area.  They must choose to follow the cat, or stay in their "comfort zone" so to speak.  They must embrace their curiosity, or ignore it.  If they choose to follow the cat, they will eventually discover a much larger area full of mysteries to be solved.

A Gameplay Exploration of Yudkowsky's "Twelve Virtues"

43 ac3raven 18 May 2011 06:56PM

Hello Less Wrong, this is my first post (kind of).  I belong to a small game development company called Shiny Ogre Games.  We have a vested interest in making games that, as Johnathan Blow puts it, "speak to the human condition."  I am here to announce our next project for you.

In this announcement for Shiny Ogre's next project, There are two points to address.  Firstly:

Thought is a process like any other. The methods by which we think can be identified, specified, defined, categorized and even predicted.  One method of thinking that has been thoroughly defined is rationality.  Many would consider rationality (i.e. the careful exercise of reason), to be an essential path toward enlightenment (hence this).

Secondly: The objective, logical, and mechanical approach to reason that rationality takes, meshes nicely with game development, because any well-defined system can be turn into a game.  A game is a system composed of players making decisions while considering objectives, governed by a rule set.

Where there is no decision there can be no game.  Where decisions matter, a game can make them matter more.

Therefore, rationality is a core component of game playing.

Games are learning tools.  They are perhaps the best learning tool available to humans, because they invoke our biological tendency to play.

With that said, our announcement:

We're making a video game about rationality.

The game will explore rationality in the context of Eliezer Yudkowsky's "Twelve Virtues of Rationality" (which we have permission for).  From a narrative perspective the game takes place inside a mind on the brink of epiphany and will heavily feature themes from Plato's "Allegory of the Cave".

Yudkowsky's twelve virtues are the basis of the twelve levels in the game, and will feature each virtue in metaphorical form.  The underlying message here is that if you master all of the twelve virtues (by completing all of the twelve levels), you will achieve 'epiphany'.

The game is a 2D side-scrolling puzzle-platformer.  The player assumes the role of a figure that represents his/her own conscious mind while it constructs machines (ala "Incredible Machine") that are a metaphor for the thoughts and concepts that one would create while meditating on a complex problem.

We will update our progress and share development information on our website here, as well as with posts on Less Wrong, our twitter account, and the game's website.

You can expect discussions of design decisions for this project to be written frequently from the angle of game design theory.  We may also release a small documentary film of the development process after the release of the game.

A release date has been set (and its not too long from now), but I don't want to announce it just yet.

Here is some concept art for our Curiosity metaphor (you can view more art at our website linked above):

If you're interested, just upvote and/or comment.  If you have any specific queries related to this project or about game design in general, it would be cool if you went here.

We will be sharing our progress as we make this game over the next few months.  So pay attention to Less Wrong and/or shinyogre.com for updates.

Thanks!