Just this week famous SF-local "Purple Ferrari With A Duck Man" (I don't know his real name) went through what seems to be a psychotic break and ended up in an armed standoff with policehttps://sfstandard.com/2026/03/17/san-francisco-nob-hill-arm...
There're some early comments saying he was having apocalyptic delusions reinforced by Gemini: this really seems to be growing as a class of issue.
What's strange to me is that, while subtle delusions are hard to deal with, delusions where the model is saying "we are at war now with those who destroyed the Earth" seem like they should be very easy to catch with a classifier, and so do the series of prompt that go this far (you can boil the frog with LLMs, but getting it to encourage violence typically requires some pretty sharp prodding.)