7/15/2026 at 8:13:38 PM
looks cool. what is latency like? I haven't used qmd before and it looks like it runs 3 local models.by rgbrgb
7/15/2026 at 8:57:08 PM
as always it depends on your hardware, the tiny models for embedding / reranking typically have low latencyqmd is focussed on local to the point of designing around single machine setups and this creates a gap where one runs agents+qmd on their laptop and LLMs on their ai box
by verdverm