gothgirl420666 comments on Dangers of steelmanning / principle of charity - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (91)
I agree, and this is sort of what I find problematic, I'll explain in a second. (Notice that all four "risks" I mentioned are risks to the Roman and not the progressive.)
I think I was a little unclear here, sorry. Imagine that the Roman is already against increasing welfare, for whatever reason. He first reads the progressive article and thinks that the progressive's argument is dumb. He then remembers steelmanning and re-interprets the article as arguing that welfare reform would incur Anonna's favor. He finally realizes that the position isn't that bad when seen in this light, and begins to be a little less certain that increasing welfare would be a bad idea. This is sort of what I was imagining when I wrote the post. The belief that's being tested is not the entire ancient Roman worldview, it's whether or not welfare should be increased.
The thing is, when the Roman creates the new argument "increasing welfare would incur Anonna's favor", that's a completely new idea that he came up with himself, and as such it should be held skeptically. Imagine if Anonna in fact liked welfare when it was in the form of gold coins and hated it when it's in the form of a vague baseless digital currency, and the Roman had no idea, not being an Anonnan priest. However, he might mistakenly think that the fact that the idea "we should increase welfare for equality" is fairly popular and held by smart people is authority for the idea "increasing welfare would incur Anonna's favor", but in fact these are pretty distinct ideas.
I feel like the steelmanning process usually outputs a new argument that you can look at and say "yeah, that kind of makes sense". But I was reading some of the "Tupac is alive" conspiracy theories the other day, and I thought they kind of make sense. For me, an argument kind of making sense is pretty bad evidence for its truth - good evidence would be if I read the argument, then the rebuttals, then the rebuttals to the rebuttals, then the rebuttals to the rebuttals to the rebuttals, and etc. until I finally found a point where I could say "okay, that really does makes sense". But I haven't had the time, or likely the ability, to do this with most arguments, so I usually form my beliefs off of vague intuitions around authority. What I guess I'm afraid of is that I'll conflate my original steelman with a superficially similar popular argument, and then these intuitions will get corrupted and I'll be confused.
Obviously the Roman thing is a pretty dumb cartoony example and it seems too obvious to fall for in real life, but I feel like this usually works on a much more subtle, implicit level, and in fact I think that's why I have a lot of trouble putting it into words. I find this topic really confusing to talk about, so hopefully I didn't say anything too dumb. I think I mainly agree with your post, though, and what everyone else is saying. Again, I think steelmanning is 90% a good thing.