7/14/2026 at 9:55:01 PM
Does this catch intermittent fallback between requests?by p_stuart82
7/14/2026 at 10:32:00 PM
Yes, picchio monitors a running llama-server on a timer and flags when the prefill/decode ratio goes CPU-shaped. I hot-swapped one mid-run. probe 4 caught ENGAGED -> NOT ENGAGED.by logickkk1