shminux comments on Open Thread, May 19 - 25, 2014 - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (289)
Hack the SAT essay:
First, some background: The SAT has an essay, graded on a scale from 1-6. The essay scoring guidelines are here . I'll quote the important ones for my purposes:
“Each essay is independently scored by two readers on a scale from 1 to 6. These readers' scores are combined to produce the 2-12 scale. The essay readers are experienced and trained high school and college teachers.” “Essays not written on the essay assignment will receive a score of zero”
Reports vary, but apparently, most grader spend between 90 seconds to 2 and a half minutes on each essay.
My challenge, inspired by the Aibox experiment, is as follows. You are an AI taking the test. You need to write an off-topic anything that will convince both graders to give you a six. (Or, if the two graders disagree by more than one point, a third grader takes over, and you only need to convince them). You have 25 minutes to actually write it, but unlimited time to plan in advance. You could probably draw anything, not just writing, but you run the risk of them seeing a picture and immediately giving a zero without having time to get hacked.
I've come up with two ideas so far:
I didn't think either of them were very good, but I like the concept. Some rules: No paying them off or threatening them with physical harm.
Can anyone come up with better ideas?
I'm putting this on open thread because it's my first real post, and I'm not sure of the reaction.
You have to reliably convince a grader in the 1-2 min they spend on it that your essay is in the top 1% or so (that's the fraction of perfect 12s), and the grader intuitively knows the score she'll give you within one point after 30 seconds or less. I doubt there is a sure way to do it without hitting their mental model of a perfect essay on all counts.
You need to reliably convince a grader that they should 1. Take more time to look at the essay or 2. Give a six, regardless of merit.
Few restrictions on how, like with AIbox. (You could tell them you're an AI, or an alien, or whatnot, as long as it's believable.)