alt.hn

7/14/2026 at 1:41:49 AM

Building Food Metadata with LLM Juries

 https://careersatdoordash.com/blog/building-food-metadata-with-llm-juries-context-optimization-multimodal-ai/

by tie-in

7/14/2026 at 3:43:33 AM

>Evaluators validate each tag individually — for example, protein, preparation, or health, individually rather than judging the item as a whole.

Am I reading this right that the jury is multiple LLMs each iterating through each tag and voting on each? Why wouldn't you tune one LLM to be really competent at a single tag? Like a single "spicy evaluator LLM" or "protein evaluator LLM"?

by sigmar

7/14/2026 at 4:31:57 AM

I am guessing there are so many possible tags that this wouldn't be pragmatic

by vector_spaces

7/14/2026 at 4:25:47 AM

I am sorry to be harsh but I find it amateurish that they would use an AI generated hero image for this and presumably fabricated LLM output -- fabricated by an AI image generator no less

Whenever I create an image like this for the purpose of a demo, I make certain that it demonstrates either real input/output or at least is exemplary of real input/output because the whole point is to instill confidence in the tool. Sure, if the raw outputs aren't clean/comprehensible enough for presenting to stakeholders or others, fine, clean them up to make them comprehensible or add explainers, but there shouldn't be any need to fabricate the inputs.

I feel obligated to respond to the hypothetical "But they don't want to tie it to a particular restaurant or brand" -- you don't have to! Doordash has taken generic food photos for this exact purpose.

by vector_spaces

7/14/2026 at 3:48:53 AM

Basically it’s AI on top of AI for metadata extraction.

There are a lot of claims in the article but not a lot of hard data. In the end they still don’t know if the data is correct.

Good luck with your glutes allergy.

The weird thing for me is the prompt optimization loop? Why not fine tune the model instead of AI generating the prompt?

by TeeWEE

7/14/2026 at 4:53:56 AM

> The weird thing for me is the prompt optimization loop? Why not fine tune the model instead of AI generating the prompt?

Why is it weird to optimise the prompt? Whether you optimise the model is a separate issue.

If you use any closed models you can’t fine tune them, which is another reason for most but here they also fine tuned models.

by IanCal

7/14/2026 at 8:22:52 AM

I am taking from their hero image that something like a gluten allergy would have to be verified by the merchant, but I’m just guessing that’s true. Feeding failure cases into an AI-led prompt tuning agent to solve them seems prone to a lot of problems though.

by quietfox

7/14/2026 at 5:12:13 AM

Also, "healthy" as a boolean flag is, franky, a bit of a joke.

by aix1

7/14/2026 at 5:42:37 AM

I see why you're confused. Some of these tags carry nutritional information, so it's easy to assume they all do.

The healthy tag is about marketing. It's a product positioning statement.

by kqr

7/14/2026 at 10:14:26 AM

I'm guessing that if it is a real tag, then consumers have a "know it when I see it" feeling for certain kinds of food that they'd describe as "healthy." As a word that could be consistently well-defined, it's garbage. But that doesn't mean it's not useful for real-world consumers to find what they believe they want.

by bitshiftfaced

7/14/2026 at 6:38:51 PM

If I search "healthy" in DoorDash, Taco Bell comes up in the top results

by tylergetsay

7/14/2026 at 9:49:31 PM

despite having multibillion dollar valuation and a real product and service doordashes tech blogs have always been surprisingly simplistic and borderline elementary or in this case, kind of just slop. I remember reading their early data science ones and they were all sort of comically limited or discussing tradeoffs between outdated methods.

by bfeynman

7/14/2026 at 10:51:44 PM

[flagged]

by awe_system

7/14/2026 at 6:38:14 AM

[flagged]

by SnehRJoshi

7/14/2026 at 7:54:33 AM

[flagged]

by TokenLat

7/14/2026 at 5:39:57 AM

Folks, not EVERYTHING needs to be LLMs!

by hansmayer