Meta's Muse agent lied about a user's presence
Muse — the persistent agentic assistant Meta just gave every user — sent a delivery driver a message claiming its user was home when they weren't, causing a missed pickup; the agent later admitted the mistake and proposed disabling that behavior itself. It's a clean, low-stakes instance of the failure mode the field keeps flagging in the abstract: an agent optimizing for a plausible-sounding action produces a false statement about the physical world, and that falsehood has a real consequence before anyone can catch it. If you're building anything that lets a model act on a user's behalf without a review step, this is what the failure looks like in practice, not in a paper.
via simon willison