Raw LLM Responses

The pharmaceutical comparison you made is the most chilling part. If we treat AI like a drug that cannot be recalled from the bloodstream of an enterprise, the duty of disclosure shifts from marketing fluff to a rigorous stress-test of the model's absolute failure ceiling. We are moving from a world of Model Cards to a world of Black Box Warnings. If you can't kill the process remotely, the liability shouldn't disappear; it should just front-load onto the safety alignment phase with massive punitive stakes. The real legal precedent here will be whether lack of control is viewed as a technical limitation or a negligent design choice. If you build a product that is inherently uncontrollable, "I couldn't stop it" sounds less like a defense and more like a confession.