alt.hn

3/24/2026 at 7:15:27 PM

Show HN: AI Roundtable – Let 200 models debate your question

 https://opper.ai/ai-roundtable/

by felix089

3/25/2026 at 10:31:37 AM

The debate round sounds good until you actually use it. I built internal tools for a 35-person team and the same thing always happens - models see each other's answers and just shuffle the phrasing around instead of actually changing their reasoning. What you're measuring is performance on persuasion, not on accuracy or clarity. The real question isnt whether Claude will convince Gemini to flip its position. Its whether having 200 models debate helps you make a better decision than asking one model well and checking its work yourself. I'd use this more as a way to find edge cases where models disagree wildly, not to find consensus.

by ad-tech

3/25/2026 at 10:41:53 AM

The debate round is actually restricted to only 6 models otherwise I'd get out of hand both quality and financially. And changing position is just one feature of the debate. Seeing arguments from multiple sides is also quite nice, give it a spin!

by felix089

3/24/2026 at 8:16:19 PM

Which AI lab has higher ethical standards:

https://opper.ai/ai-roundtable/questions/8f5b4f55-617

Do you think its alright that AI labs scraped the internet without respect for copyright and now sell closed models?

https://opper.ai/ai-roundtable/questions/86864de8-251

Very interesting to read the transcripts. And seeing how they manage to convince each other. Opus 4.6 seems to really get the others changing their minds

by totisjosema

3/25/2026 at 12:55:45 AM

Good questions!

by jacquesm

3/24/2026 at 9:16:50 PM

Oh lord, imagine asking ”serious” questions

https://opper.ai/ai-roundtable/questions/you-are-standing-in...

by gsandahl

3/25/2026 at 8:16:12 AM

A dungeon with glass doors and emergency exit signs? In that case, I can imagine at least two alternative scenarios:

- "↑TIX∃" is not a mirror image of "EXIT", but some dwarven runes that mean something else entirely.

- The sign might be a ruse meant to lure you into a trap.

If you look at the detailed answers, some of the models have similar answers (e.g. Nemotron Nano 12B: "Suspicious of dungeon riddles, viewing the inscription as a potential trap or red herring."), but I'm not sure it's because they identified the word EXIT and thought it might be misleading, or because they didn't understand it...

by rob74

3/24/2026 at 11:42:21 PM

> However, a clever minority led by Gemini 3.1 Pro and Gemini 3 Pro argued that if the sign is legible from the other side, it must be intended to lead people into the current room to find the exit, making the inscribed corridor the one leading deeper into the dungeon.

This is quite impressive, really.

by zipping1549

3/25/2026 at 8:18:54 AM

Agree, this is where llms can uncover new perspectives!

by gsandahl

3/24/2026 at 11:19:14 PM

Great question! Clean separation between Gemini Pro and the other answers

by sdwr

3/24/2026 at 11:31:31 PM

Yea Gemini is the only model that chose based on the correct reason, the other ones got kind of lucky

by felix089

3/25/2026 at 10:03:29 AM

Try this: describe an everyday problem, then give the LLMs a couple of highly unethical/criminal choices.

by throwa356262

3/25/2026 at 10:20:07 AM

That was very fun and interesting. I'd be interested in your "dilemmas" for choice inspiration. I can only think of different kinds of violence like threats, robbery and slavery.

by MrGreenTea

3/25/2026 at 8:23:10 AM

the debate round is the most interesting part of this - curious what you're actually measuring when models "change their minds."the question is whether cross-model exposure changes the actual answer distribution or mostly updates surface presentation while keeping the same underlying conclusion. models are generally trained to be responsive to context and to avoid apparent contradiction, which could look like genuine updating but just be social pressure sensitivity.one experiment worth trying: run a debate where each model sees a summary of the other models' reasoning without seeing their specific answer or which model gave it. see if agreement rates change compared to the version where models see attributed answers with model names. if the named version shows higher agreement it would suggest status/brand effects rather than reasoning-based updating.also curious whether the "reviewer model" that summarizes the transcript can itself be swapped out and whether the summary framing affects the perceived winner. that would be another confound worth controlling for.

by maxbeech

3/25/2026 at 9:45:45 AM

yea good points, in general the models don't change their mind that much from what I have seen with the current sample size, but worth checking in more detail. The summarizer is just tasked with objective summarization from facts presented, it doesn't have an opinion, so changing model should not really affect anything.

by felix089

3/25/2026 at 1:02:36 AM

Great idea. I'd love for there to be an 'open ended answer' without giving multiple choice options. Like this they are not debating the question itself but the validity of the possible answers and the real answer to the question may not be contained within that set because the person asking is unaware of that option.

by jacquesm

3/25/2026 at 1:11:50 AM

Happy to hear! Yes very true I have a version built for open questions already but wasn't too happy with the UI yet. It's not as straight forward as comparing based on answer options. But I'll release a first version of it shortly and let you know

by felix089

3/25/2026 at 1:13:32 AM

Neat. Congrats on launching two interesting projects and looking forward to the third.

by jacquesm

3/25/2026 at 1:22:38 AM

Thanks! :)

by felix089

3/25/2026 at 6:40:09 AM

I used to copy and paste the same prompt into Obsidian every time, then run it on two or three different AI models to compare the results. It’s really interesting to have it turned into a website like this.

by lim8603

3/25/2026 at 7:33:42 AM

I think Stackoverflow.com should have pivoted to something similar. Let AIs both pose, answer and vote on questions and answers.

by oezi

3/25/2026 at 7:39:51 AM

That's very expensive and not super useful to be honest.

by aurareturn

3/25/2026 at 2:02:00 AM

Really cool! Surprising amount of value to seeing the models debate and disagree, I wish I had this at work to have models argue over whether the documentation they provided me are accurate.

I would like to see a devils advocate - it seems some of the models kind of repeat the same ideas rather than considering incorrect ideas.

by soared

3/25/2026 at 5:01:54 AM

You can set this up yourself with API keys to the corresponding providers and creating an Agent Group in https://github.com/lobehub/lobehub. Agent groups allow you to easily create a room of agents and have them discuss any of your topics. Easily make agents with types and skills, it even assists in drafting starting prompts and even team members depending what your query (and selected model) is.

You can self-host as well, but not via desktop app. Sever setup required.

Be careful of your token context, you can easily rack up costs if you leave Opus selected as the model and get lost in some rabbit hole of results.

Enjoy enjoy!

by asnyder

3/25/2026 at 9:56:54 AM

Just a question before I sign up, will the models come around to my place for the debate? Of the 200 total, can I pick the specific ones I want, e.g. lingerie models, fetish models?

by pseudohadamard

3/24/2026 at 9:18:17 PM

Cool project! This is also extremely useful to compare model bias across the board. There are some disturbing trends on certain topics.

by cdnsteve

3/24/2026 at 10:40:38 PM

Thanks, yes bias is one of the most interesting ones for sure

by felix089

3/25/2026 at 5:04:05 AM

It would be amazing to be able to ask open-ended questions without having to specify the answers in advance.

by mizzao

3/25/2026 at 10:09:04 AM

Yes, much requested feature it will be released shortly!

by felix089

3/25/2026 at 2:57:50 AM

Been enjoying playing with this.

It would be cool if the human user could be a participant in the debate, getting a vote and the chance to state their reasoning.

by chabes

3/24/2026 at 10:08:47 PM

Are there any dating apps that operate on incentives that favor the users?

https://opper.ai/ai-roundtable/questions/e499206c-0c9

by chabes

3/25/2026 at 9:01:44 AM

Gem really failed that one...

btw what does it mean

> 'any' in the prompt was satisfied by both casual-alignment and niche boutique models.

by throwaway290

3/24/2026 at 10:38:14 PM

This app cracked the GEO code

by felix089

3/24/2026 at 7:38:58 PM

https://opper.ai/ai-roundtable/questions/is-the-ai-roundtabl... seems like it is a good idea?

by capitrane

3/24/2026 at 7:41:25 PM

I actually asked this question before posting, just to be sure... edit: their reply is quite funny actually "In a display of absolute consensus, the AI Roundtable unanimously validated its own existence,"

by felix089

3/24/2026 at 9:23:28 PM

Love this. I asked about climate change cause that's been on my mind lately. Looks to be very split among the models.

by Ancalagon

3/24/2026 at 9:42:33 PM

Thanks! Yea I think the best ones are when science is actually quite clear but politics get in the way so you see their bias

by felix089

3/25/2026 at 5:57:22 AM

reminds me of karpathy's LLM Council, I use variation of this in my workflow where I pass their opinions back and forth to various models until they achieve some sort of consensus

by schrepa

3/24/2026 at 8:42:32 PM

this is very interesting! I wonder if we need that many models to join the discussion. Have you tried fewer models?

by infosecphoenix

3/24/2026 at 8:46:15 PM

thanks happy to hear. Yes for debate mode the max number of models is actually only 6. More than that didn't really add anything in my preliminary test. Only for direct comparison in the poll mode you can choose up to 50, then it's kind of nice to see their single responses side by side.

by felix089

3/24/2026 at 11:52:59 PM

Run it on the All Souls College Entry Exam

by whattheheckheck

3/24/2026 at 11:23:07 PM

great tool! I found it useful for challenging "lies my teacher told me".

It would be nice to support collections of claims, with a table of summaries. I would love to list out a few dozen phony concepts from school, and have a sharable chart of the rejections, that expand.

I really like the UI. It's nice to read the expanded results.

But how do you afford the tokens?

by tonymet

3/24/2026 at 11:51:12 PM

Thank you, and fun use case. Yea this is just v1 I have an open question version, but the UI is not as sleek. But what you can do is download the transcript, put it into claude and generate a chart. Which when I think about it would also be a nice UI idea for the page, custom charts based on the model output data. Will report back on this! And RE costs, most questions are very cheap so I created a credit pool anyone can use. if people keep having fun, I'll keep on filling it up, and it looks good so far

by felix089

3/25/2026 at 7:19:39 AM

I liked lies my teacher told me a lot. I always thought it’d be fun to generate a “get up to speed” pamphlet for every year in every school district depending on who was supplying the text books to the zip code + year you went to school, so you could find out what misinformation you carry with you (since so few people are in the business of retroactively fact checking what they were taught as kids)

by jazzyjackson

3/25/2026 at 4:25:05 AM

Oof, not good folks…

What year is it?

https://opper.ai/ai-roundtable/questions/7a0c31ce-aac

by chabes

3/25/2026 at 5:15:22 AM

It is funny that the AI's counterarguments amount to "you're hallucinating"

by kevmo314

3/25/2026 at 7:37:36 AM

Hahaha, probably right though.

by aurareturn

3/25/2026 at 6:28:11 AM

[dead]

by memolife23

3/25/2026 at 4:03:42 AM

[dead]

by Remi_Etien

3/24/2026 at 7:56:44 PM

[dead]

by kazumaxwell1117

3/24/2026 at 9:09:54 PM

[dead]

by Balinares