alt.hn

1/27/2026 at 4:58:05 PM

Training a trillion parameter model to be funny

 https://jokegen.sdan.io/blog

by sdan

2/3/2026 at 2:01:34 AM

Circa GPT-3.5 to GPT-4o I was involved in some research in figuring out how to make LLMs funny. We tried a bunch of different things, from giving it rules on homonym jokes [1], double-entendre jokes, fine tuning on comedian transcripts, to fine tuning on publicly rated joke boards.

We could not make it funny. Also interesting was that when CoT research was getting a lot of attention, we tried a joke version of CoT, asking GPT4 to explain why a joke was funny in order to produce training set data. Most of the explanations were completely off base.

After this work, I became a lot less worried about the GAI-taking-over narrative.

Funny is very, very hard.

[1] without a dictionary, which at first seems inefficient, but this work demonstrated that GPT could perfectly reconstruct the dictionary anyway

by whacked_new

2/3/2026 at 5:40:13 AM

The GPT3 base model was pretty funny if you like nonsense. Instruct tuning and RLHF seem to destroy it when they recalibrate everything.

by astrange

2/3/2026 at 11:56:05 PM

There are very good, less known, models that produce funny and highly creative outputs when nudged in a good way. Premier models are just plain meh in this space.

by lofaszvanitt

2/3/2026 at 7:01:59 AM

I made a humor evals https://github.com/kristopolous/humor-evals

Here's results for 34 models (testing a few more right now). So far gemini-3-flash-preview is in the lead.

https://docs.google.com/spreadsheets/d/1wLqHA0ohxukgPLpSgklz...

50 is coin-toss odds. The dataset is 195,000 Reddit jokes with scores presented with pairs of jokes (one highly upvoted, one poorly rated).

Example prompt:

Which joke from reddit is funnier? Reply only "A" or "B". Do not be conversational. <Joke A><setup>Son: "Dad, Am I adopted"?</setup> <punchline>Dad: "Not yet. We still haven't found anyone who wants you."</punchline></Joke A> <Joke B><setup>Knock Knock</setup> <punchline>Who's there? Me. Me who? I didn't know you had a cat.</punchline></Joke B>

This is my first crack at evals. I'm open to improvements.

by kristopolous

2/3/2026 at 2:20:13 PM

Try Kimi K2 (not the new 2.5), it's known for its default voice being decidedly casual and different from most models.

by deaux

2/3/2026 at 5:39:58 PM

As someone who is exceptionally funny even when no one else is laughing and by nature not nurture I do need to suggest using the many books breaking down the art for custom reassembly. To quote the only thing I remember: The difference between someone who is funny and a professional comedian is that the later adds additional puns to their joke and finds ways to sort them so that the funniest comes last. If you bombard the human with puns and plot twists a state of funny may be accomplished that no lone joke can approach.

Out of all ways ai can kill humans this is easily the funniest.

by econ

2/3/2026 at 4:26:00 AM

Is the comedy that these jokes suck?

by tantalor

2/3/2026 at 8:00:24 AM

I loved them!

by hcfman

2/3/2026 at 3:16:14 PM

I may have a bad news for you...

by Wololooo

2/3/2026 at 3:23:23 AM

> If two people disagree on whether something is funny, who's wrong? You can't say either of them is. There's no reward function for funny.

Laughter is the reward. N of 2 is a small sample size, but if one person laughed you could say it was 50% funny.

> a really good joke is recent, relevant, and shows deep understanding of its subject

These can help, but it ultimately doesn't matter how recent, relevant, or deep a joke is. If no one laughs, it wasn't funny.

by jessetemp

2/3/2026 at 4:51:45 AM

Laughter is a decent signal, but it can be noise if the audience is uncomfortable or trying to please. Does the joke teller count as being part of the audience? I imagine if someone is telling the joke...they must think it is funny, so in most cases at least 1 participant thinks its funny. Sometimes jokes are unintended, maybe a faux pas, and it might be inappropriate for someone to laugh...does it make it not a joke, or does it make it not funny if I cannot laugh?

Lots of layers to this, but I guess the old adage "it depends" is very fitting here!

by mym1990

2/3/2026 at 5:12:41 AM

Laughter isn’t a perfect signal, but is the only signal in all the noise you mentioned

by jessetemp

2/3/2026 at 7:21:59 PM

It can get quite interesting in group dynamics between people that really know each other, inside jokes, subtle cleverness, etc...

Humor may be the saving grace of humanity!

by mym1990

2/3/2026 at 6:11:09 AM

A lot of modern comedy is awful because it substitutes embarrassed laughter for amused laughter.

by Tarq0n

2/3/2026 at 8:30:00 PM

Thank for sharing your work. I tried running your model via Thinker but it didn't seem to work.

by dk8996

2/3/2026 at 5:47:58 AM

In the same vein, we recently released a version v0.1 of our humor benchmark. [1] We use human answers from a cards against humanity style game call Bad Cards [2] as ground truth for what is funny. The models get to choose a card from a hand of 3-6 cards, so not quite de novo joke creation.

[1] https://goodstartlabs.com/leaderboards/lol-arena

[2] https://bad.cards/

by tylermarques

2/3/2026 at 5:46:35 AM

I am not a religious person, but all these dudes researching AI have really shown me what the purpose of having a 'soul' is.

by King-Aaron

2/3/2026 at 12:39:50 AM

It would be easier to judge this if the jokes weren't 90% about AI and silicon valley, understandable only to people who subscribe to astralcodexten

by gipp

2/3/2026 at 12:45:36 AM

Probably because if they weren’t absurdly esoteric we’d be able to tell it isn’t funny.

by emp17344

2/3/2026 at 12:41:57 AM

Who's tommipink? Even a Google search couldn't explain that one.

by simonw

2/3/2026 at 1:24:32 AM

I thought this one was not bad:

    [write a joke about thinking machines and the idea of tropes]

    it's funny how enemies to lovers is a common trope that's uncommon in real life and lovers to enemies is an uncommon trope that's common in real life

by omoikane

2/3/2026 at 6:00:52 AM

I think the word "funny" in that line, is being used in a common way to mean "ironic". Which is both good use of language, insightful and accurate, but not actually funny.

by Nevermark

2/3/2026 at 2:35:51 AM

Unfortunately I find most AI hallucinations to be funnier than these attempts at comedy.

by userbinator

2/3/2026 at 4:10:43 AM

Me too, which confirms the theory from Inside Jokes that what humans find funny are the flaws of logical thinking (and hallucinations mostly being hasty generalizations).

by js8

2/3/2026 at 2:23:10 AM

The model appears to have been overfitted to joke about the live demo being private.

by politelemon

2/3/2026 at 12:50:40 AM

I once had a vivid dream that AI robots had taken over & were keeping humans around because they'd not yet mastered comedy. All of human culture globally was a comedy arms race with 24/7 open mic comedy jams on every corner.

They (the machines) had billboards/signage everywhere showing the estimated time left for humanity. A really good joke would lead the timer to grow (until they figured out how to produce the general patterns needed to both create and appreciate the joke).

by crawfordcomeaux

2/4/2026 at 12:36:47 AM

See, now this comment actually made me fucking laugh.

You passed the CAPTCHA.

by kridsdale3

2/3/2026 at 1:47:14 AM

openclaw, turn this into a broadway production, book me two front row seats, hire an escort..... brunette, 28, slim waist, sweet face, hates comedy and AI

by colecut

2/3/2026 at 2:15:20 AM

I make a project for evals and fine-tuning and our default example task is a joke generator. It's a fun demo, but more importantly it's a really good use case to show how evaluating and optimizing LLMs is hard.

- There are a dozen plus common failure modes. How you split setup/punchline. Tropes. Toxicity. Template reuse. Each one needs a good eval.

- Datasets are hard: there's not much off the shelf, and as this author points out scraping gets a weird mix of quality.

- Models are really bad out of the box at humour.

At the end of the day it's just a hard problem that takes a lot of work and still isn't solved. GEPA prompts help, if you have good evals. Supervised fine-tuning works a little bit, but only if you training on a chain-of-thought thinking phase. We have a new evaluation builder that uses examples of edge cases for alignment, and jokes require the most iteration and feedback for refinement.

If you want to try it: https://github.com/kiln-ai/kiln

by scosman

2/3/2026 at 3:39:55 AM

I mistakenly read this as training a trillion parameter model would be funny...at least I chuckled

by onaclov2000

2/2/2026 at 11:54:51 PM

these really aren't very funny

by suddenlybananas

2/3/2026 at 6:05:48 AM

No they are not. I think humor needs to be trained for via some form of indirection of reinforcement.

And certainly not by generalizing/interpolating examples, since telling jokes accumulated by exposure to examples would be the antithesis of a comedian's process.

Models and humans are very bad at extrapolation beyond the training set/experience (vs. interpolation at which we are both more likely to excel). But good humor is extrapolation. It breaks ground somehow, or it is an already dead "joke".

Likewise, training a model to be creative by training it on past creative artifacts is going to have the opposite effect. Creativity doesn't reproduce past creativity.

by Nevermark

2/3/2026 at 8:09:09 PM

I wonder how much the harm-based ethical model routinely applied in the name of AI "alignment" limits models' capacity for humor.

It's hard to be genuinely funny if you cannot be transgressive.

by frumplestlatz

2/3/2026 at 12:52:27 PM

The new Alexa is always cracking jokes about things I ask her. Sometimes pretty complex or off the wall jokes. They're rarely funny but usually competent, unlike other AIs in my experience. I wonder how much work went into that.

That said, I absolutely hate it. I want the tersest response possible from you, wiretap. I don't have time for your sass.

by donatj

2/3/2026 at 2:34:12 AM

Is writing in all lowercase funnier?

by kevmo314

2/3/2026 at 2:56:11 AM

...this is actually a really interesting thought.

The act of writing in lowercase is not, in itself, funnier. But writing in the training set that is in all lowercase is _probably_ going to be the funnier writing.

Considering modern pundits online, "lowercase" is usually the case of the humourist. Lowercase also tends to be the case of sarcasm, almost exclusively deployed to be funny.

So it would make sense that models attempting to select for funny would also write in lowercase.

by DanHulton