HughRistik comments on Sociosexual Orientation Inventory, or failing to perform basic sanity checks - Less Wrong

3 Post author: taw 16 September 2009 10:00AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (41)

You are viewing a single comment's thread. Show more comments above.

Comment author: HughRistik 16 September 2009 09:45:35PM 1 point [-]

Yeah, there could be some lying going on (though there doesn't have to be a "spectacular" amount; see Psychohistorian's response).

However, just because people tend to lie about a certain behavior, it doesn't make it useless to try to measure it. Rather than just giving up, psychologists often employ measures that will detect deceptiveness or social desirability bias such as the Marlowe-Crowne scale.

Doing anything with answers to questions you know people systemically lie about, you need to ask yourself what are you really measuring.

True. But at least in this case, people who underreport on this scale probably have less of what it's actually trying to measure than people with the same behavior who report accurately. Since the SOI is about orientation, then how forthcoming and proud you are of the behavior it measures could be seen as part of that orientation.

Comment author: taw 16 September 2009 10:03:58PM 2 points [-]

For one amount of lying changes drastically depending on tiny details of how the test is administered. If you know about widespread lying is, and want to include it, you need to standardize testing conditions.

Comment author: Douglas_Knight 17 September 2009 01:58:03PM *  0 points [-]

Doing anything with answers to questions you know people systemically lie about, you need to ask yourself what are you really measuring...

For one amount of lying changes drastically depending on tiny details of how the test is administered. If you know about widespread lying is, and want to include it, you need to standardize testing conditions.

Those are good points. They definitely could produce better measures.