[Link] AI advances: computers can be almost as funny as people

5 Post author: shminux 02 August 2013 06:41PM

"Our model significantly outperforms a competitive baseline and generates funny jokes 16% of the time, compared to 33% for human-generated jokes."

From this paper:

Unsupervised joke generation from big data

Sasa Petrovic and David Matthews

The 51st Annual Meeting of the Association for Computational Linguistics - Short Papers (ACL Short Papers 2013) 
Sofia, Bulgaria, August 4-9, 2013

 


 

Abstract

Humor generation is a very hard problem. It is difficult to say exactly what makes a joke funny, and solving this problem algorithmically is assumed to require deep semantic understanding, as well as cultural and other contextual cues. We depart from previous work that tries to model this knowledge using ad-hoc manually created databases and labeled training examples. Instead we present a model that uses large amounts of unannotated data to generate I like my X like I like my Y, Z jokes, where X, Y, and Z are variables to be filled in. This is, to the best of our knowledge, the first fully unsupervised humor generation system. Our model significantly outperforms a competitive baseline and generates funny jokes 16% of the time, compared to 33% for human-generated jokes.

 

From The Register:

It uses 2,000,000 noun-adjective pairs of words to draw up jokes "with an element of surprise", something the creators claim is key to good comedy.

...

 jokes calculated by the software include:

  • I like my relationships like I like my source code... open

Comments (17)

Comment author: calef 02 August 2013 06:44:42PM 12 points [-]
Comment author: ikrase 02 August 2013 07:06:47PM 3 points [-]

Of course, the phrases that appear in the paper are the funnest...

Comment author: sediment 03 August 2013 08:52:33PM *  2 points [-]

Two comments, one trivial and one more important:

trivial: personally, I don't think any of the jokes are really very funny. Then again, I never really liked the particular formula they're using, and I'm willing to accept that my taste in humour might be a little idiosyncratic.

important: I might be stating the obvious here, but I don't think it's really that enlightening to compare this with human joke-making, as I think they're mostly doing different things. Although the computer can do a passable job at filling in the variables for a given formula, that's a far cry from coming up with the formula in the first place. That's the impressive act of creativity, and after-the-fact mimicry of the same is much less impressive. When a computer gag program is flexible enough to come up with less stereotyped, formulaic gags, then I'll be impressed.

I'm reminded of, for example, EMI, Experiments In Musical Intelligence, David Cope's computer program capable of writing startlingly good pieces in the style of dead composers - but, of course, unable to come up with a distinctive, expressive style of its own.

Comment author: Vladimir_Nesov 03 August 2013 09:08:45PM *  1 point [-]

That's the impressive act of creativity, and after-the-fact mimicry of the same is much less impressive.

This reminds me of the following articles, which probably don't reflect your intended sentiment, but might help some readers:

Comment author: sediment 03 August 2013 10:29:58PM *  0 points [-]

Nice. For what it's worth, my post's sentiment was pretty much wholescale cribbed from one or two of the essays in Hofstadter's book, Metamagical Themas.

Comment author: CronoDAS 03 August 2013 04:48:25AM 2 points [-]

I like my relationships like I like my source code... open

That's really good.

Comment author: MixedNuts 04 August 2013 05:54:12PM -1 points [-]

I've heard this joke before I heard of the paper, and found it funny. I'm surprised nobody's come up with that one before.

Comment author: Lumifer 02 August 2013 07:19:04PM -2 points [-]

In other words, the paper's authors consider funny 16% of random combinations of X, Y, and Z inserted into the pattern of "I like my X like l like my Y, Z".

Comment author: thomblake 02 August 2013 07:37:21PM 10 points [-]

No, the completely random baseline generated funny jokes 3.7% of the time.

Comment author: Lumifer 02 August 2013 07:56:02PM *  10 points [-]

They get bonus points for their metrics of LOcal Log-likelihood (aka LOL-likelihood) and Rank OF Likelihood (aka ROFL).

They also get demerits for not discussing the error bars on their estimates given that they had only five testers.

Comment author: sediment 03 August 2013 08:48:34PM 0 points [-]

I actually quite like the idea of completely random gags in this formula. I feel like I might even prefer them to the lame ones given by the ostensibly smarter algorithm. It could be a rich vein of absurdist, non-sequitur laughs.

Comment author: ikrase 04 August 2013 09:48:32PM 5 points [-]

I think that many nonsequitor jokes are funny more by targeted nonsequitorness than by randomness.

Comment author: shminux 02 August 2013 08:56:11PM *  0 points [-]

Humor generation is a very hard problem.

Unfortunately computers can't tell which of the jokes they generate are actually funny, which is an even harder problem. I wonder if there is any research in that direction.

EDIT: apparently they can.

Comment author: buybuydandavis 03 August 2013 08:08:58AM 4 points [-]

Use joke evaluator to filter output of joke generator. Bam! Massive improvement on joke hit rate.

Comment author: Document 03 August 2013 07:50:55AM 1 point [-]

I haven't read the article or the paper, but in fairness, humans are also pretty good at finding humor in things (there are older examples).

Comment author: johlstei 04 August 2013 04:10:04PM 0 points [-]

There's another abstract on this topic here: http://acl2013.org/site/short/2316.html

I'm not sure how to find the actual paper link, though someone posted this one below.