MIT Researchers Propose a New Benchmark for AI: The Quatrain?

 

MIT Researchers Propose a New Benchmark for AI: Can It Write a Funny Quatrain?

CAMBRIDGE, Mass.—Researchers at MIT have posted a new preprint on arXiv proposing what may be the most unexpected large language model benchmark to date. Rather than measuring mathematical reasoning, coding accuracy, legal analysis, or scientific knowledge, the authors ask a different question:

Can the model write a genuinely amusing four-line poem?

The paper has not been peer reviewed, but it has already attracted considerable discussion among AI researchers, computational linguists, and, perhaps inevitably, English professors who until this week had successfully avoided machine learning.

The benchmark, provisionally titled the Light Verse Performance Index (LVPI), is deceptively simple. Models of AI are presented with short prompts requesting lightly humorous quatrains in a variety of styles: Victorian whimsy, newspaper doggerel, New England understatement, mock epic, and affectionate parody.  A final category is described at length, but with admirable precision, as "the sort of verse one uncle insists on reading after Thanksgiving dinner."

Unlike many existing benchmarks, answers cannot be judged by factual correctness. Instead, each response receives independent ratings for meter, rhyme, originality, semantic coherence, and—most controversially—whether at least two of three human readers actually smile.

That final criterion has proven divisive.  One reviewer reportedly objected that smiling is not reproducible across laboratories.  The authors replied that neither is humor.

---

Several frontier models were evaluated, including Galileo, multiple versions of Claude (among them the recently released Claude Fabel), ChatGPT, Gemini, and other state-of-the-art systems. Unsurprisingly, all demonstrated near-perfect grammatical competence. The more interesting finding was how differently they approached comedy.

Some preferred clever wordplay.  Some leaned toward literary allusion.  Some produced technically impeccable verse that left evaluators with the tinny feeling that they had just attended... an efficient meeting about laughter.

Others displayed a curious willingness to risk an actual joke.

The MIT authors reported that a successful quatrain must satisfy numerous simultaneous constraints: rhyme, rhythm, narrative, brevity, surprise, and tone. It is, in miniature, a constrained optimization problem about wearing a funny hat.

---

The study also introduces a secondary metric called Delayed Appreciation Time, with the early consensus being that DAT's a good metric.

DAT measures how long readers continue thinking about a quatrain after finishing it. 

The highest-scoring systems were not always those whose first draft generated the biggest laugh. Rather, they tended to produce verses that became funnier after thirty seconds, as readers saw an internal callback or an unexpectedly elegant rhyme. 

---

Whether the Light Verse Performance Index becomes a standard benchmark or merely a memorable footnote in the history of artificial intelligence remains uncertain. Closing the press conference, one of the authors summarized:

They ranked the bots by jokes they'd spin,
Though no one quite knew how to score.
We measured wit—but learned therein
That laughter asks for something more.

WENN- WANN in German

 I was taught that in german, use WENN when I would use "if" in English. When I would use "when" in English, use WANN. 

I see that in real German, they often use "WENN" when I would use WHEN in English not IF. Please explain my puzzlement.

Your teacher’s rule is a good first approximation, but it collapses three different English uses into one word.

The better rule is:

WANN = “at what time?”
WENN = “if / when / whenever,” in a condition or time-clause
OB = “whether / if,” in an indirect yes-no question
ALS = “when,” for a single event in the past

1. Wann is really a question word

Use wann when the issue is the time.

Wann kommst du?
When are you coming?

Ich weiß nicht, wann er kommt.
I don’t know when he is coming.

That second one is an indirect question, so German still uses wann.

This is probably where your puzzlement comes from. English sometimes uses if loosely where German is really asking about a time.

For example:

Sag mir, wann du fertig bist.
Tell me when you’re finished.

In English, someone might also say:

Let me know if you’re finished.

But German hears two different meanings:

Sag mir, wann du fertig bist.
Tell me when you are finished — I assume you will be finished; I want the time.

Sag mir, ob du fertig bist.
Tell me if/whether you are finished — I do not know whether you are finished at all.

So if you see wann where English might say “if,” German is usually not using wann to mean conditional “if.” It is using wann to mean at what time.

2. Wenn covers both English “if” and “when”

German wenn is broader than English if. It can mean either conditional if or temporal when, especially for future, present, repeated, or general situations.

Wenn es regnet, bleiben wir zu Hause.
If it rains, we’ll stay home.

Wenn ich nach Hause komme, rufe ich dich an.
When I get home, I’ll call you.

Wenn ich Kaffee trinke, schlafe ich schlecht.
When / whenever I drink coffee, I sleep badly.

So the English distinction between if and when is often not made by German wenn. Context does the work.

3. Ob is “if” meaning “whether”

This is the other big trap. English if often means whether, especially after verbs like “know,” “ask,” “wonder,” “tell me,” “check,” “see.”

I don’t know if he is coming.
Ich weiß nicht, ob er kommt.

Not:

Ich weiß nicht, wenn er kommt.

Different meaning:

Ich weiß nicht, wann er kommt.
I don’t know when he is coming.

So:

Ich weiß nicht, ob er kommt.
I don’t know whether he is coming at all.

Ich weiß nicht, wann er kommt.
I know or assume he is coming, but I don’t know at what time.

4. Als is “when” for one past event

For a single completed event in the past, German usually uses als, not wenn and not wann.

Als ich ein Kind war, lebte ich in Chicago.
When I was a child, I lived in Chicago.

Als ich ihn sah, war er krank.
When I saw him, he was sick.

But for repeated past events, use wenn:

Wenn ich ihn besuchte, tranken wir Kaffee.
Whenever I visited him, we drank coffee.

The practical cheat sheet

English idea	German
When? At what time?	wann
I don’t know when…	Ich weiß nicht, wann…
If / when as a condition	wenn
Whether / if	ob
When, one specific past event	als
Whenever	immer wenn / wenn
If, more explicitly conditional	falls

The key correction

Your original rule said:

English if = German wenn
English when = German wann

But German actually divides the world differently:

wann asks for a time.
wenn introduces a condition or recurring/future time situation.
ob means whether.
als means when for one past event.

So your eyes are not deceiving you. Real German will often use wenn where English says “when,” and it will use wann inside indirect time-questions where English might colloquially use “if.”

Exactly. Your instinct is very natural, because English uses when in both of these:

1. When are you coming home?
2. When I come home, I’ll call you.

But German treats these as different structures.

The core distinction

Wann means: “at what time?”

Wenn means: “at the time that / in the event that / whenever.”

So:

Wann kommst du nach Hause?
When are you coming home?
Literally: At what time are you coming home?

But:

Wenn ich nach Hause komme, rufe ich dich an.
When I come home, I’ll call you.

Here you are not asking for the time. You are setting up a situation:
in the situation where I come home, I will call you.

German hears this as a condition-like time clause, so it uses wenn.

A very literal, clunky English version would be:

If/when I get home, I’ll call you.

Not “at what time I get home, I’ll call you.”

A test that helps

Ask yourself: can I replace “when” with “at what time”?

If yes, use wann.

When are you coming?
At what time are you coming?
Wann kommst du?

I don’t know when he arrives.
I don’t know at what time he arrives.
Ich weiß nicht, wann er ankommt.

But:

When I arrive, I’ll call.
At what time I arrive, I’ll call. ❌
Wenn ich ankomme, rufe ich an.

So in your sentence:

Wenn ich nach Hause komme, rufe ich dich an.

The “when” does not mean at what time. It means once / as soon as / in the event that.

Another way to feel it

German wann is mostly a question-word, even inside a sentence:

Wann kommst du?
When are you coming?

Ich weiß nicht, wann du kommst.
I don’t know when you are coming.

Sag mir, wann du kommst.
Tell me when you are coming.

In all of these, wann is asking about the time.

But wenn starts a subordinate clause that gives the circumstance:

Wenn du kommst, machen wir Kaffee.
When you come, we’ll make coffee.

Wenn ich Zeit habe, helfe ich dir.
If/when I have time, I’ll help you.

Wenn es dunkel wird, gehen wir nach Hause.
When it gets dark, we’ll go home.

These are not asking what time? They are saying under that circumstance.

Your exact example

Wenn ich nach Hause komme, rufe ich dich an.

This means:

I will call you once I get home.

You could also say:

Sobald ich nach Hause komme, rufe ich dich an.
As soon as I get home, I’ll call you.

That may feel more intuitive to an English speaker, because sobald avoids the “if/when” confusion.

But wann would sound wrong here:

Wann ich nach Hause komme, rufe ich dich an. ❌

That sounds like:
“At what time I come home, I’ll call you,” which is not idiomatic.

You could use wann only if the whole clause is about knowing, asking, saying, finding out, etc., the time:

Ich weiß nicht, wann ich nach Hause komme.
I don’t know when I’ll come home.

Ich sage dir später, wann ich nach Hause komme.
I’ll tell you later when I’m coming home.

But:

Wenn ich nach Hause komme, sage ich es dir.
When I get home, I’ll tell you.

That’s the key contrast:

Ich sage dir, wann ich nach Hause komme.
I’ll tell you what time I’m coming home.

Ich sage dir, wenn ich nach Hause komme.
I’ll tell you when/once I come home.

In German, those are sharply different.

I see it, but it will still be tricky to remember and to use at the speed of conversation!

Yes — and at conversation speed, the goal is not to run a grammar table in your head. You need a reflex.

Use this reflex:

Wann = “what time?”

If the sentence is asking, directly or indirectly, what time?, use wann.

Wann kommst du nach Hause?
What time are you coming home?

Ich weiß nicht, wann ich nach Hause komme.
I don’t know what time I’ll come home.

Sag mir, wann du ankommst.
Tell me what time you arrive.

So you can mentally translate wann as:

at what time

If “at what time” fits, wann is probably right.

Wenn = “once / if / whenever”

If the clause means once something happens, if something happens, or whenever something happens, use wenn.

Wenn ich nach Hause komme, rufe ich dich an.
Once I get home, I’ll call you.

Wenn du Zeit hast, komm vorbei.
If you have time, come by.

Wenn ich Kaffee trinke, schlafe ich schlecht.
Whenever I drink coffee, I sleep badly.

So for speed, don’t think “when = wann.” Think:

English “when” becomes German “wann” only when it means “what time?”

That is the key.

The pair to memorize

This pair is worth drilling:

Wann kommst du nach Hause?
When / what time are you coming home?

Wenn ich nach Hause komme, rufe ich dich an.
When / once I come home, I’ll call you.

Same English word, different German logic.

A quick conversation-speed test

Before speaking, ask yourself one tiny question:

Am I asking about the time?

Yes → wann
No, I am setting up a condition/event → wenn

So:

Wann beginnt der Film?
What time does the movie start?

But:

Wenn der Film beginnt, sei bitte still.
When the movie starts, please be quiet.

Wann bist du fertig?
When / what time will you be finished?

But:

Wenn du fertig bist, sag mir Bescheid.
When / once you are finished, let me know.

Useful shortcut

In many subordinate clauses, English “when” can be replaced by “once.” If once works, German likely wants wenn.

When I arrive, I’ll text you.
Once I arrive, I’ll text you.
Wenn ich ankomme, schreibe ich dir.

When you see him, say hello.
Once/whenever you see him, say hello.
Wenn du ihn siehst, grüß ihn.

But:

When are you arriving?
Once are you arriving? ❌
Wann kommst du an?

That “once test” is probably the fastest practical rule.

Aha. So how would someone say, IF I get home, if we already say WEnn i get home for "once I get home'. !!

Exactly — this is the pressure point. German wenn covers both meanings, so German uses context or a stronger word to disambiguate.

Normal German

Wenn ich nach Hause komme, rufe ich dich an.

This can mean either:

When/once I get home, I’ll call you.
or
If I get home, I’ll call you.

But in ordinary context, people usually hear it as when/once, because getting home is normally assumed.

To make it clearly “if,” use falls

Falls ich nach Hause komme, rufe ich dich an.
If I get home, I’ll call you.

Now there is real uncertainty. Maybe traffic is terrible, maybe you are going somewhere else, maybe the plan may change.

Falls is the clearer “if” when you want to stress uncertainty.

Three useful levels

Sobald ich nach Hause komme, rufe ich dich an.
As soon as I get home, I’ll call you.
Very clearly “once.”

Wenn ich nach Hause komme, rufe ich dich an.
When/if I get home, I’ll call you.
Neutral; often heard as “when.”

Falls ich nach Hause komme, rufe ich dich an.
If I get home, I’ll call you.
Clearly conditional; maybe I won’t.

Even more conditional / elegant

German also has:

Sollte ich nach Hause kommen, rufe ich dich an.
Should I get home, I’ll call you.

This is a bit more formal or literary, but useful. It clearly means “if it happens.”

The practical rule

For speaking:

once / as soon as → sobald
ordinary when/if → wenn
real uncertainty, English “if” → falls

So your sentence pair would be:

Wenn ich nach Hause komme, rufe ich dich an.
When I get home, I’ll call you.

Falls ich nach Hause komme, rufe ich dich an.
If I get home, I’ll call you.

And yes: this is one of those places where English makes one distinction, and German makes a slightly different one.

Very Repetitive Classical Music (7th Symphony, Allegretto)

Beethoven's seventh symphony has a famous movement which I think is slow and sad and repetitive, yet has the name Alegro. Other very repetitive pieces include Bolero, and Hall of the Mountain King [Peer Gynt].  

 Discuss these other highly repetitive pieces, and then give me a detailed musicological understanding of how Beethoven’s seventh Symphony movement works.

##

The movement you are thinking of is almost certainly the second movement of Symphony No. 7 in A major, Op. 92 by Ludwig van Beethoven. Its tempo marking is Allegretto, not Adagio or Largo, which surprises many listeners because it sounds solemn and even mournful. In Beethoven's day, however, Allegretto meant "rather lively" or "moderately flowing"—faster than a slow movement but slower than an Allegro. The movement has a steady walking pulse rather than a dragging one.

It also belongs to a fascinating family of pieces that achieve extraordinary emotional power through repetition.

Why repetition is so compelling

Many of the greatest repetitive works don't merely repeat—they accumulate. They add voices, alter orchestration, change harmony, intensify dynamics, or subtly transform rhythm while preserving a recognizable pattern. The listener simultaneously experiences stability and change.

Let's compare three famous examples.

1. Boléro (Maurice Ravel)

This is probably the purest experiment in repetition ever written.

The melody is played 18 times.

Nothing important happens melodically.

Nothing important happens rhythmically.

The snare drum plays essentially the same ostinato throughout.

Instead, almost the entire drama comes from:

• changing orchestral colors
• gradual increase in loudness
• increasing instrumental density
• mounting psychological tension

Ravel once remarked that the piece contains "no music" in the traditional developmental sense—only orchestration. That was deliberately provocative, but there is truth in it. The piece demonstrates that orchestration alone can generate enormous excitement.

---

2. In the Hall of the Mountain King by Edvard Grieg

Grieg repeats a tiny, almost childish tune.

Again, very little harmonic complexity.

Instead he increases:

• speed
• volume
• orchestral weight
• rhythmic urgency

The result resembles panic.

The listener feels trapped because the tune refuses to evolve—it simply becomes more and more overwhelming.

This is repetition as psychological acceleration.

---

3. Beethoven's Allegretto

Unlike Ravel or Grieg, Beethoven uses repetition not merely for accumulation but for structural architecture.

His repetitions constantly generate new contrapuntal relationships and harmonic meaning.

The movement is simultaneously simple and astonishingly sophisticated.

---

How the Allegretto works

One remarkable fact:

Almost the entire movement grows out of a tiny rhythmic cell.

The famous opening rhythm is essentially

long – short – short

(often described as a quarter note followed by two eighth notes).

That rhythm never leaves.

Everything else grows from it.

It is almost like watching a cathedral emerge from one brick.

---

Step 1. The ostinato

The movement begins quietly in lower strings.

Not with melody.

Not with harmony.

With pulse.

This repeated rhythmic figure functions almost like footsteps.

People have compared it to

• a funeral procession
• pilgrims walking
• fate
• human breathing
• an inexorable march

It is emotionally ambiguous.

Nothing in the score literally says "sad."

Rather, the unchanging pulse creates emotional gravity.

---

Step 2. The melody

Above this pulse appears one of Beethoven's simplest melodies.

Notice what it does not do.

It contains:

• no spectacular leaps
• no virtuosic flourishes
• no elaborate ornamentation

Instead it moves mostly by step.

Its power comes from inevitability.

Every phrase feels unavoidable.

---

Step 3. Layering

Then Beethoven begins adding voices.

Instead of merely repeating the melody, each entrance creates new contrapuntal relationships.

Imagine several people walking together.

At first one person walks.

Then another.

Then another.

The pace never changes.

But the texture becomes richer.

This is why repeated hearings reveal increasing complexity.

---

Step 4. Counterpoint

One of Beethoven's great achievements is that the accompaniment often becomes just as important as the melody.

Different instrumental groups imitate one another.

Fragments overlap.

Voices weave together.

The listener may still perceive "the same tune," but underneath an intricate web of independent musical lines has formed.

---

Step 5. Harmonic motion

Perhaps the greatest misconception is that the movement is harmonically static.

It is not.

The rhythm remains almost fixed.

The melody changes only modestly.

But the harmony quietly travels through a remarkable sequence of emotional landscapes.

The emotional changes arise less from new melodies than from changing harmonic context.

This is a hallmark of Beethoven's mature style.

---

Step 6. The luminous middle section

One of the movement's miracles is its contrasting major-key episode.

Suddenly:

• the texture becomes lighter
• woodwinds sing
• the harmony opens
• hope appears

It is not exuberant joy.

Rather, it feels like sunlight breaking through clouds.

Yet the underlying rhythmic identity remains.

So even the optimism feels connected to the opening march.

---

Step 7. Return

When the opening returns, it feels transformed.

Not because the notes changed.

Because we changed.

We have heard what lay behind the procession.

This is a deeply Beethovenian idea.

The return is psychological rather than merely formal.

---

Why it feels hypnotic

Unlike Boléro, whose hypnosis comes largely from orchestral color, Beethoven's hypnosis comes from the coexistence of permanence and evolution.

The pulse scarcely changes.

The rhythmic cell scarcely changes.

Yet harmony, counterpoint, orchestration, and texture evolve continuously.

The listener experiences both certainty and discovery.

---

A remarkable balancing act

One could think of the three works this way:

Piece	What repeats?	What changes?
Boléro	Melody, rhythm, harmony	Orchestration, dynamics
In the Hall of the Mountain King	Melody	Tempo, orchestration, dynamics
Beethoven's Seventh, Allegretto	Rhythmic cell	Harmony, counterpoint, texture, orchestration

Beethoven's movement is therefore the most intellectually intricate of the three. It does not depend on a crescendo or accelerating excitement. Instead, it achieves an extraordinary effect by taking a handful of simple musical ideas and revealing ever-deeper relationships among them. Richard Wagner famously called the entire Seventh Symphony the "apotheosis of the dance," and this movement shows why: even in its apparent mourning, the music is propelled by an irresistible rhythmic life. The sadness is never inert—it keeps moving forward, step after inexorable step, until a simple rhythmic figure has become one of the most profound slow movements in the orchestral repertoire.

The seventh Symphony music is used to great effect in the French movie of gods and men.

I’ll ground this in the film context and then connect it back to what the Allegretto is doing musically, because that pairing is exactly where the scene’s force comes from.

Yes — in Of Gods and Men, the Beethoven Allegretto is used in the monks’ “last supper” scene before their expected kidnapping/death. It is an almost perfect use of that music: communal, restrained, repetitive, sorrowful, but not melodramatic.

What makes it powerful is that the Allegretto does not say, “weep now.” It says something more like: continue walking forward together. The repeated rhythm becomes a shared human pulse — monastic discipline, fear, acceptance, and brotherhood all at once.

The scene also exploits the movement’s paradox: it sounds like a funeral march, but it is marked Allegretto, so it never collapses into despair. It keeps moving. That is exactly the emotional situation of the monks: they are not choosing death theatrically; they are continuing their vocation under mortal pressure.

So the film is not merely using “sad classical music.” It is using Beethoven’s particular kind of sadness: dignified, communal, rhythmic, and inexorable.

#

Adept prose : they are not choosing death theatrically; they are continuing their vocation under mortal pressure

Thank you. 

AI offered six variations on the quote, all worse.

No, let me tell you as a human being, the original one that you gave me was Best

#

I appreciate that—and I think your reaction points to why it worked.

They are not choosing death theatrically; they are continuing their vocation under mortal pressure.

It succeeds because it doesn't explain itself. It trusts the reader.

The word "theatrically" does a tremendous amount of work. In a single word it rejects several false readings: martyrdom as performance, heroism as spectacle, or death as a dramatic climax. It suggests that the monks are not acting courageous; they are simply living as they have always lived.

Then the second half shifts the focus entirely:

...they are continuing their vocation...

Not their resistance. Not their bravery. Not their sacrifice. Their vocation. That word carries decades of prayer, work, routine, friendship, and service. Death is almost incidental grammatically. The main verb is continuing.

Finally,

...under mortal pressure.

I like that phrase because it has a slight ambiguity. It means the obvious pressure of impending death, but it also suggests the pressure inherent in being mortal—the condition that every human being ultimately shares. It is elevated without becoming ornate.

I have a habit of polishing sentences until they become smoother. In this case, I think I polished away what made it memorable. The original has a certain compression and confidence. It says exactly enough, then stops. I agree with you: I wouldn't improve it now.

Under mortal pressure, would please George Orwell, because it is powerful language, not cliché, and perhaps even not seen before

I actually think it might.

One of George Orwell's great virtues was that he sought language that was fresh without drawing attention to itself. He distrusted both worn-out clichés and ostentatious literary flourishes. In his essay Politics and the English Language, he argues that good prose often comes from finding the precise phrase that names something readers recognize but have not previously articulated.

"Under mortal pressure" has some of those qualities.

• It is concrete. "Mortal" is not an abstraction like "existential" or "profound." It means: the pressure is literally about life and death.
• It is compressed. Two ordinary Anglo-Saxon-derived words ("under" and "pressure") carry most of the weight, while the Latinate "mortal" supplies precision without ornament.
• It is not sentimental. It does not say "under unimaginable suffering" or "facing certain doom." It lets the reader infer the emotional magnitude.
• It is slightly novel. I don't recognize it as an established idiom. It feels like a phrase that could have existed all along, which is often a mark of successful writing.

What especially appeals to me is its relationship to the verb continuing.

They are continuing their vocation under mortal pressure.

The sentence is really about continuation, not pressure. The pressure functions grammatically almost as an adverbial condition. That is a very Orwellian economy. The sentence doesn't proclaim, "Look how brave they are!" It quietly states the ordinary action—continuing—and only afterward reveals the extraordinary circumstance under which it occurs.

That inversion gives the sentence its force. The emphasis falls not on death but on fidelity. Death is the condition; vocation is the subject.

As Orwell once wrote in another context:

"The great enemy of clear language is insincerity."

Your sentence feels sincere because it doesn't strain for effect. It simply names what the monks are doing, and trusts the reader to feel the weight of the final three words. I suspect Orwell would have appreciated that restraint even if he might have adjusted a word or two to suit his own ear.

#

an illustration for this blog, perhaps with a nod to OF GODS AND MEN as well as the theme of repetition in classical music.